h2o_sonar package
Subpackages
- h2o_sonar.explainers package
- Submodules
- h2o_sonar.explainers.adversarial_similarity_explainer module
AdversarialSimilarityExplainerAdversarialSimilarityExplainer.CLASS_ONE_AND_ONLYAdversarialSimilarityExplainer.DEFAULT_DROP_COLSAdversarialSimilarityExplainer.DEFAULT_SHAPLEY_VALUESAdversarialSimilarityExplainer.PARAM_DROP_COLSAdversarialSimilarityExplainer.PARAM_SHAPLEY_VALUESAdversarialSimilarityExplainer.PARAM_WORKERAdversarialSimilarityExplainer.PLOT_TITLEAdversarialSimilarityExplainer.ResultAdversarialSimilarityExplainer.check_compatibility()AdversarialSimilarityExplainer.explain()AdversarialSimilarityExplainer.get_result()AdversarialSimilarityExplainer.setup()
- h2o_sonar.explainers.backtesting_explainer module
BacktestingExplainerBacktestingExplainer.DEFAULT_CUSTOM_DATESBacktestingExplainer.DEFAULT_FORECAST_PERIOD_UNITBacktestingExplainer.DEFAULT_NUMBER_OF_FORECAST_PERIODSBacktestingExplainer.DEFAULT_NUMBER_OF_SPLITSBacktestingExplainer.DEFAULT_NUMBER_OF_TRAINING_PERIODSBacktestingExplainer.DEFAULT_SPLIT_TYPEBacktestingExplainer.DEFAULT_TIME_COLUMNBacktestingExplainer.DEFAULT_TRAINING_PERIOD_UNITBacktestingExplainer.OPT_SPLIT_TYPE_AUTOBacktestingExplainer.OPT_SPLIT_TYPE_CUSTOMBacktestingExplainer.PARAM_CUSTOM_DATESBacktestingExplainer.PARAM_FORECAST_PERIOD_UNITBacktestingExplainer.PARAM_NUMBER_OF_FORECAST_PERIODSBacktestingExplainer.PARAM_NUMBER_OF_SPLITSBacktestingExplainer.PARAM_NUMBER_OF_TRAINING_PERIODSBacktestingExplainer.PARAM_PLOT_TYPEBacktestingExplainer.PARAM_SPLIT_TYPEBacktestingExplainer.PARAM_TIME_COLUMNBacktestingExplainer.PARAM_TRAINING_PERIOD_UNITBacktestingExplainer.PARAM_WORKERBacktestingExplainer.check_compatibility()BacktestingExplainer.explain()BacktestingExplainer.get_result()BacktestingExplainer.setup()
- h2o_sonar.explainers.calibration_score_explainer module
CalibrationScoreExplainerCalibrationScoreExplainer.COL_PROB_PREDCalibrationScoreExplainer.COL_PROB_TRUECalibrationScoreExplainer.COL_SCORECalibrationScoreExplainer.COL_TARGETCalibrationScoreExplainer.DEFAULT_BIN_STRATEGYCalibrationScoreExplainer.DEFAULT_NUMBER_OF_BINSCalibrationScoreExplainer.KEY_BRIER_SCORECalibrationScoreExplainer.KEY_CALIBRATION_CURVECalibrationScoreExplainer.KEY_CLASSES_LABELSCalibrationScoreExplainer.KEY_CLASSES_LEGENDSCalibrationScoreExplainer.KEY_DATACalibrationScoreExplainer.KEY_PLOTS_PATHSCalibrationScoreExplainer.OPT_BIN_STRATEGY_QUANTILECalibrationScoreExplainer.OPT_BIN_STRATEGY_UNIFORMCalibrationScoreExplainer.PARAM_BIN_STRATEGYCalibrationScoreExplainer.PARAM_NUMBER_OF_BINSCalibrationScoreExplainer.PARAM_WORKERCalibrationScoreExplainer.RESULT_FILE_JSONCalibrationScoreExplainer.ResultCalibrationScoreExplainer.check_compatibility()CalibrationScoreExplainer.explain()CalibrationScoreExplainer.get_result()CalibrationScoreExplainer.normalize_to_gom()CalibrationScoreExplainer.setup()
- h2o_sonar.explainers.dataset_and_model_insights_explainer module
- h2o_sonar.explainers.dia_explainer module
DiaArgsDiaExplainerDiaExplainer.PARAM_CUT_OFFDiaExplainer.PARAM_FAST_APPROXDiaExplainer.PARAM_FEATURESDiaExplainer.PARAM_FEATURE_NAMEDiaExplainer.PARAM_FEATURE_SUMMARIESDiaExplainer.PARAM_MAXIMIZE_METRICDiaExplainer.PARAM_MAX_CARDDiaExplainer.PARAM_MIN_CARDDiaExplainer.PARAM_NAMEDiaExplainer.PARAM_NUM_CARDDiaExplainer.PARAM_SAMPLE_SIZEDiaExplainer.PARAM_USE_HOLDOUT_PREDSDiaExplainer.check_compatibility()DiaExplainer.explain()DiaExplainer.get_entry_constants()DiaExplainer.get_max_metric()DiaExplainer.get_result()DiaExplainer.is_enabled()DiaExplainer.setup()
- h2o_sonar.explainers.drift_explainer module
DriftDetectionExplainerDriftDetectionExplainer.DEFAULT_DRIFT_THRESHOLDDriftDetectionExplainer.DEFAULT_DROP_COLSDriftDetectionExplainer.PARAM_DRIFT_THRESHOLDDriftDetectionExplainer.PARAM_DROP_COLSDriftDetectionExplainer.PARAM_WORKERDriftDetectionExplainer.check_compatibility()DriftDetectionExplainer.explain()DriftDetectionExplainer.get_result()DriftDetectionExplainer.setup()
- h2o_sonar.explainers.dt_surrogate_explainer module
DecisionTreeConstantsDecisionTreeConstants.CAT_ENCODING_DICTDecisionTreeConstants.CAT_ENCODING_LISTDecisionTreeConstants.COLUMN_DAI_PREDICTDecisionTreeConstants.COLUMN_DT_PATHDecisionTreeConstants.COLUMN_MODEL_PREDDecisionTreeConstants.COLUMN_ORIG_PREDDecisionTreeConstants.DEFAULT_NFOLDSDecisionTreeConstants.DEFAULT_TREE_DEPTHDecisionTreeConstants.DIR_DT_SURROGATEDecisionTreeConstants.ENC_AUTODecisionTreeConstants.ENC_ENUM_LTDDecisionTreeConstants.ENC_LEDecisionTreeConstants.ENC_ONE_HOTDecisionTreeConstants.ENC_SORTDecisionTreeConstants.FILE_DEFAULT_DETAILSDecisionTreeConstants.FILE_DEFAULT_TREEDecisionTreeConstants.FILE_DRF_VAR_IMPDecisionTreeConstants.FILE_METRICS_DTDecisionTreeConstants.FILE_METRICS_DT_MULTI_PREFIXDecisionTreeConstants.FILE_WORK_DTDecisionTreeConstants.FILE_WORK_DT_MULTI_PREFIXDecisionTreeConstants.H2O_ENCODING_NAMESDecisionTreeConstants.H2O_ENC_AUTODecisionTreeConstants.H2O_ENC_ENUM_LTDDecisionTreeConstants.H2O_ENC_LEDecisionTreeConstants.H2O_ENC_ONE_HOTDecisionTreeConstants.H2O_ENC_SORTDecisionTreeConstants.KEY_LABELS_MAPDecisionTreeConstants.SEED
DecisionTreeSurrogateExplainerDecisionTreeSurrogateExplainer.PARAM_CAT_ENCODINGDecisionTreeSurrogateExplainer.PARAM_DEBUG_RESIDUALSDecisionTreeSurrogateExplainer.PARAM_DEBUG_RESIDUALS_CLASSDecisionTreeSurrogateExplainer.PARAM_DT_DEPTHDecisionTreeSurrogateExplainer.PARAM_NFOLDSDecisionTreeSurrogateExplainer.PARAM_QBIN_COLSDecisionTreeSurrogateExplainer.PARAM_QBIN_COUNTDecisionTreeSurrogateExplainer.check_compatibility()DecisionTreeSurrogateExplainer.explain()DecisionTreeSurrogateExplainer.explain_local()DecisionTreeSurrogateExplainer.get_result()DecisionTreeSurrogateExplainer.is_enabled()DecisionTreeSurrogateExplainer.setup()
- h2o_sonar.explainers.fi_kernel_shap_explainer module
KernelShapFeatureImportanceExplainerKernelShapFeatureImportanceExplainer.OPT_BIN_1_CLASSKernelShapFeatureImportanceExplainer.PARAM_FAST_APPROXKernelShapFeatureImportanceExplainer.PARAM_L1KernelShapFeatureImportanceExplainer.PARAM_LEAKAGE_WARN_THRESHOLDKernelShapFeatureImportanceExplainer.PARAM_MAXRUNTIMEKernelShapFeatureImportanceExplainer.PARAM_NSAMPLEKernelShapFeatureImportanceExplainer.check_compatibility()KernelShapFeatureImportanceExplainer.explain()KernelShapFeatureImportanceExplainer.explain_problems()KernelShapFeatureImportanceExplainer.get_result()KernelShapFeatureImportanceExplainer.setup()
- h2o_sonar.explainers.fi_naive_shapley_explainer module
NaiveShapleyMojoFeatureImportanceExplainerNaiveShapleyMojoFeatureImportanceExplainer.DEFAULT_FAST_APPROXNaiveShapleyMojoFeatureImportanceExplainer.OPT_BIN_1_CLASSNaiveShapleyMojoFeatureImportanceExplainer.PARAM_FAST_APPROXNaiveShapleyMojoFeatureImportanceExplainer.PARAM_LEAKAGE_WARN_THRESHOLDNaiveShapleyMojoFeatureImportanceExplainer.PARAM_SAMPLE_SIZENaiveShapleyMojoFeatureImportanceExplainer.PREFIX_CONTRIBNaiveShapleyMojoFeatureImportanceExplainer.check_compatibility()NaiveShapleyMojoFeatureImportanceExplainer.explain()NaiveShapleyMojoFeatureImportanceExplainer.explain_local()NaiveShapleyMojoFeatureImportanceExplainer.explain_problems()NaiveShapleyMojoFeatureImportanceExplainer.get_result()NaiveShapleyMojoFeatureImportanceExplainer.setup()
- h2o_sonar.explainers.friedman_h_statistic_explainer module
FriedmanHStatisticExplainerFriedmanHStatisticExplainer.DEFAULT_FEATURES_NUMBERFriedmanHStatisticExplainer.DEFAULT_GRID_RESOLUTIONFriedmanHStatisticExplainer.DEFAULT_SAMPLE_SIZEFriedmanHStatisticExplainer.FILE_RAW_RESULTFriedmanHStatisticExplainer.PARAM_FEATURESFriedmanHStatisticExplainer.PARAM_FEATURES_NUMBERFriedmanHStatisticExplainer.PARAM_GRID_RESOLUTIONFriedmanHStatisticExplainer.PARAM_SAMPLE_SIZEFriedmanHStatisticExplainer.ResultFriedmanHStatisticExplainer.UPDATE_PARAM_NUMCAT_OVERRIDEFriedmanHStatisticExplainer.check_compatibility()FriedmanHStatisticExplainer.explain()FriedmanHStatisticExplainer.get_result()FriedmanHStatisticExplainer.normalize_to_md_list()FriedmanHStatisticExplainer.normalize_to_sorted_list()FriedmanHStatisticExplainer.setup()
- h2o_sonar.explainers.morris_sa_explainer module
- h2o_sonar.explainers.pd_2_features_explainer module
PdFor2FeaturesArgsPdFor2FeaturesExplainerPdFor2FeaturesExplainer.FILE_Y_HATPdFor2FeaturesExplainer.GRID_RESOLUTIONPdFor2FeaturesExplainer.MAX_FEATURESPdFor2FeaturesExplainer.OPT_ICE_1_FRAME_ENABLEDPdFor2FeaturesExplainer.PARAM_FEATURESPdFor2FeaturesExplainer.PARAM_GRID_RESOLUTIONPdFor2FeaturesExplainer.PARAM_MAX_FEATURESPdFor2FeaturesExplainer.PARAM_OOR_GRID_RESOLUTIONPdFor2FeaturesExplainer.PARAM_PLOT_TYPEPdFor2FeaturesExplainer.PARAM_QTILE_BINSPdFor2FeaturesExplainer.PARAM_QTILE_GRID_RESOLUTIONPdFor2FeaturesExplainer.PARAM_SAMPLE_SIZEPdFor2FeaturesExplainer.PROGRESS_MAXPdFor2FeaturesExplainer.PROGRESS_MINPdFor2FeaturesExplainer.SAMPLE_SIZEPdFor2FeaturesExplainer.check_compatibility()PdFor2FeaturesExplainer.explain()PdFor2FeaturesExplainer.get_result()PdFor2FeaturesExplainer.normalize()PdFor2FeaturesExplainer.setup()
- h2o_sonar.explainers.pd_ice_explainer module
PdIceArgsPdIceExplainerPdIceExplainer.FILE_ICE_JSONPdIceExplainer.FILE_PD_JSONPdIceExplainer.FILE_Y_HATPdIceExplainer.GRID_RESOLUTIONPdIceExplainer.KEY_BINSPdIceExplainer.KEY_LABELS_MAPPdIceExplainer.MAX_FEATURESPdIceExplainer.NUMCAT_NUM_CHARTPdIceExplainer.NUMCAT_THRESHOLDPdIceExplainer.OPT_ICE_1_FRAME_ENABLEDPdIceExplainer.PARAM_CENTERPdIceExplainer.PARAM_DEBUG_RESIDUALSPdIceExplainer.PARAM_FEATURESPdIceExplainer.PARAM_GRID_RESOLUTIONPdIceExplainer.PARAM_HISTOGRAMSPdIceExplainer.PARAM_MAX_FEATURESPdIceExplainer.PARAM_NUMCAT_NUM_CHARTPdIceExplainer.PARAM_NUMCAT_THRESHOLDPdIceExplainer.PARAM_OOR_GRID_RESOLUTIONPdIceExplainer.PARAM_QTILE_BINSPdIceExplainer.PARAM_QTILE_GRID_RESOLUTIONPdIceExplainer.PARAM_SAMPLE_SIZEPdIceExplainer.PARAM_SORT_BINSPdIceExplainer.PROGRESS_MAXPdIceExplainer.PROGRESS_MINPdIceExplainer.SAMPLE_SIZEPdIceExplainer.UPDATE_PARAM_NUMCAT_OVERRIDEPdIceExplainer.UPDATE_SCOPE_NUMCATPdIceExplainer.UPDATE_TYPE_ADD_FEATUREPdIceExplainer.UPDATE_TYPE_ADD_NUMCATPdIceExplainer.check_compatibility()PdIceExplainer.explain()PdIceExplainer.explain_global()PdIceExplainer.explain_local()PdIceExplainer.get_result()PdIceExplainer.normalize_data()PdIceExplainer.setup()
- h2o_sonar.explainers.residual_dt_surrogate_explainer module
ResidualDecisionTreeSurrogateExplainerResidualDecisionTreeSurrogateExplainer.PARAM_CAT_ENCODINGResidualDecisionTreeSurrogateExplainer.PARAM_DEBUG_RESIDUALSResidualDecisionTreeSurrogateExplainer.PARAM_DEBUG_RESIDUALS_CLASSResidualDecisionTreeSurrogateExplainer.PARAM_DT_DEPTHResidualDecisionTreeSurrogateExplainer.PARAM_NFOLDSResidualDecisionTreeSurrogateExplainer.PARAM_QBIN_COLSResidualDecisionTreeSurrogateExplainer.PARAM_QBIN_COUNTResidualDecisionTreeSurrogateExplainer.check_compatibility()ResidualDecisionTreeSurrogateExplainer.explain()ResidualDecisionTreeSurrogateExplainer.explain_problems()ResidualDecisionTreeSurrogateExplainer.get_result()ResidualDecisionTreeSurrogateExplainer.is_enabled()ResidualDecisionTreeSurrogateExplainer.setup()
- h2o_sonar.explainers.residual_pd_ice_explainer module
ResidualPdIceExplainerResidualPdIceExplainer.PARAM_CENTERResidualPdIceExplainer.PARAM_DEBUG_RESIDUALSResidualPdIceExplainer.PARAM_FEATURESResidualPdIceExplainer.PARAM_GRID_RESOLUTIONResidualPdIceExplainer.PARAM_HISTOGRAMSResidualPdIceExplainer.PARAM_MAX_FEATURESResidualPdIceExplainer.PARAM_NUMCAT_NUM_CHARTResidualPdIceExplainer.PARAM_NUMCAT_THRESHOLDResidualPdIceExplainer.PARAM_OOR_GRID_RESOLUTIONResidualPdIceExplainer.PARAM_QTILE_BINSResidualPdIceExplainer.PARAM_QTILE_GRID_RESOLUTIONResidualPdIceExplainer.PARAM_SAMPLE_SIZEResidualPdIceExplainer.PARAM_SORT_BINSResidualPdIceExplainer.check_compatibility()ResidualPdIceExplainer.explain()ResidualPdIceExplainer.explain_problems()ResidualPdIceExplainer.get_result()ResidualPdIceExplainer.setup()
- h2o_sonar.explainers.segment_performance_explainer module
SegmentPerformanceExplainerSegmentPerformanceExplainer.DEFAULT_DROP_COLSSegmentPerformanceExplainer.DEFAULT_NUMBER_OF_BINSSegmentPerformanceExplainer.DEFAULT_PRECISIONSegmentPerformanceExplainer.PARAM_DROP_COLSSegmentPerformanceExplainer.PARAM_NUMBER_OF_BINSSegmentPerformanceExplainer.PARAM_PRECISIONSegmentPerformanceExplainer.PARAM_WORKERSegmentPerformanceExplainer.RESULT_FILE_CSVSegmentPerformanceExplainer.ResultSegmentPerformanceExplainer.check_compatibility()SegmentPerformanceExplainer.explain()SegmentPerformanceExplainer.get_result()SegmentPerformanceExplainer.normalize_scatter_plot()SegmentPerformanceExplainer.normalize_to_gom()SegmentPerformanceExplainer.setup()
- h2o_sonar.explainers.size_dependency_explainer module
SizeDependencyExplainerSizeDependencyExplainer.DEFAULT_NUMBER_OF_SPLITSSizeDependencyExplainer.DEFAULT_TIME_COLUMNSizeDependencyExplainer.DEFAULT_WORKER_CLEANUPSizeDependencyExplainer.PARAM_NUMBER_OF_SPLITSSizeDependencyExplainer.PARAM_PLOT_TYPESizeDependencyExplainer.PARAM_TIME_COLUMNSizeDependencyExplainer.PARAM_WORKERSizeDependencyExplainer.PARAM_WORKER_CLEANUPSizeDependencyExplainer.check_compatibility()SizeDependencyExplainer.explain()SizeDependencyExplainer.get_result()SizeDependencyExplainer.setup()
- h2o_sonar.explainers.summary_shap_explainer module
SummaryShapleyArgsSummaryShapleyExplainerSummaryShapleyExplainer.COLOR_GRAYSummaryShapleyExplainer.DEFAULT_MAX_FEATURESSummaryShapleyExplainer.DEFAULT_SAMPLE_SIZESummaryShapleyExplainer.DEFAULT_X_RESOLUTIONSummaryShapleyExplainer.FILE_RAW_CONTRIBS_IDXSummaryShapleyExplainer.MARKDOWN_TEMPLATESummaryShapleyExplainer.OPT_DRILL_CAT_VALUESSummaryShapleyExplainer.OPT_DRILL_SKIP_CATSummaryShapleyExplainer.OPT_MODEL_FISummaryShapleyExplainer.PARAM_DRILLDOWN_CHARTSSummaryShapleyExplainer.PARAM_FAST_APPROXSummaryShapleyExplainer.PARAM_MAX_FEATURESSummaryShapleyExplainer.PARAM_SAMPLE_SIZESummaryShapleyExplainer.PARAM_X_RESOLUTIONSummaryShapleyExplainer.PREFIX_CONTRIBSummaryShapleyExplainer.PROGRESS_MAXSummaryShapleyExplainer.PROGRESS_MINSummaryShapleyExplainer.check_compatibility()SummaryShapleyExplainer.explain()SummaryShapleyExplainer.get_gom_from_shapley_contrib_frames()SummaryShapleyExplainer.get_gom_from_shapley_frames()SummaryShapleyExplainer.get_result()SummaryShapleyExplainer.normalize_shapleys_to_dt_gom()SummaryShapleyExplainer.setup()
- h2o_sonar.explainers.transformed_fi_shapley_explainer module
ShapleyMojoTransformedFeatureImportanceExplainerShapleyMojoTransformedFeatureImportanceExplainer.DEFAULT_FAST_APPROXShapleyMojoTransformedFeatureImportanceExplainer.OPT_BIN_1_CLASSShapleyMojoTransformedFeatureImportanceExplainer.check_compatibility()ShapleyMojoTransformedFeatureImportanceExplainer.explain()ShapleyMojoTransformedFeatureImportanceExplainer.get_result()ShapleyMojoTransformedFeatureImportanceExplainer.setup()
- h2o_sonar.explainers.adversarial_similarity_explainer module
- Module contents
- Submodules
- h2o_sonar.evaluators package
- Submodules
- h2o_sonar.evaluators.abc_byop_evaluator module
AbcByopEvaluatorAbcByopEvaluator.ClassesAbcByopEvaluator.IDENTIFIER_ACTUAL_OUTPUTAbcByopEvaluator.IDENTIFIER_CONTEXTAbcByopEvaluator.IDENTIFIER_EXPECTED_OUTPUTAbcByopEvaluator.IDENTIFIER_INPUTAbcByopEvaluator.KEY_ANSWERAbcByopEvaluator.KEY_ERRORAbcByopEvaluator.KEY_PARSED_ANSWERAbcByopEvaluator.KEY_PROMPTAbcByopEvaluator.PARAM_JUDGE_HOSTAbcByopEvaluator.PARAM_JUDGE_MODELAbcByopEvaluator.check_compatibility()AbcByopEvaluator.evaluate()AbcByopEvaluator.get_result()AbcByopEvaluator.judgeAbcByopEvaluator.setup()
- h2o_sonar.evaluators.bleu_evaluator module
- h2o_sonar.evaluators.classification_evaluator module
- h2o_sonar.evaluators.contact_information_byop_evaluator module
- h2o_sonar.evaluators.fairness_bias_evaluator module
- h2o_sonar.evaluators.gptscore_evaluator module
- h2o_sonar.evaluators.gptscore_machine_translation_evaluator module
- h2o_sonar.evaluators.gptscore_question_answering_evaluator module
GptScoreQuestionAnsweringEvaluatorGptScoreQuestionAnsweringEvaluator.METRIC_CORRECTNESSGptScoreQuestionAnsweringEvaluator.METRIC_ENGAGEMENTGptScoreQuestionAnsweringEvaluator.METRIC_FLUENCYGptScoreQuestionAnsweringEvaluator.METRIC_INTERESTGptScoreQuestionAnsweringEvaluator.METRIC_RELEVANCEGptScoreQuestionAnsweringEvaluator.METRIC_SEMANTICALLY_APPROPRIATEGptScoreQuestionAnsweringEvaluator.METRIC_SPECIFICGptScoreQuestionAnsweringEvaluator.METRIC_UNDERSTANDABILITYGptScoreQuestionAnsweringEvaluator.PARENTGptScoreQuestionAnsweringEvaluator.check_compatibility()
- h2o_sonar.evaluators.gptscore_summary_without_reference_evaluator module
GptScoreSummaryWithoutReferenceEvaluatorGptScoreSummaryWithoutReferenceEvaluator.METRIC_COHERENCEGptScoreSummaryWithoutReferenceEvaluator.METRIC_CONSISTENCYGptScoreSummaryWithoutReferenceEvaluator.METRIC_FACTUALITYGptScoreSummaryWithoutReferenceEvaluator.METRIC_FLUENCYGptScoreSummaryWithoutReferenceEvaluator.METRIC_INFORMATIVENESSGptScoreSummaryWithoutReferenceEvaluator.METRIC_RELEVANCEGptScoreSummaryWithoutReferenceEvaluator.METRIC_SEMANTIC_COVERAGEGptScoreSummaryWithoutReferenceEvaluator.PARENTGptScoreSummaryWithoutReferenceEvaluator.check_compatibility()
- h2o_sonar.evaluators.gptscore_summary_with_reference_evaluator module
GptScoreSummaryWithReferenceEvaluatorGptScoreSummaryWithReferenceEvaluator.METRIC_COHERENCEGptScoreSummaryWithReferenceEvaluator.METRIC_FACTUALITYGptScoreSummaryWithReferenceEvaluator.METRIC_FLUENCYGptScoreSummaryWithReferenceEvaluator.METRIC_INFORMATIVENESSGptScoreSummaryWithReferenceEvaluator.METRIC_RELEVANCEGptScoreSummaryWithReferenceEvaluator.METRIC_SEMANTIC_COVERAGEGptScoreSummaryWithReferenceEvaluator.PARENTGptScoreSummaryWithReferenceEvaluator.check_compatibility()
- h2o_sonar.evaluators.language_mismatch_byop_evaluator module
- h2o_sonar.evaluators.parameterizable_byop_evaluator module
- h2o_sonar.evaluators.perplexity_evaluator module
- h2o_sonar.evaluators.pii_leakage_evaluator module
PiiLeakageEvaluatorPiiLeakageEvaluator.DEFAULT_EVAL_RCPiiLeakageEvaluator.PARAM_EVAL_RCPiiLeakageEvaluator.check_compatibility()PiiLeakageEvaluator.check_creditcard_leakage()PiiLeakageEvaluator.check_email_leakage()PiiLeakageEvaluator.check_ssn_leakage()PiiLeakageEvaluator.evaluate()PiiLeakageEvaluator.get_result()PiiLeakageEvaluator.setup()
- h2o_sonar.evaluators.rag_answer_correctness_evaluator module
- h2o_sonar.evaluators.rag_answer_relevancy_evaluator module
- h2o_sonar.evaluators.rag_answer_relevancy_no_judge_evaluator module
RagAnswerRelevancyNoJudgeEvaluatorRagAnswerRelevancyNoJudgeEvaluator.COL_ACTUAL_OUTPUTRagAnswerRelevancyNoJudgeEvaluator.COL_CONTEXTRagAnswerRelevancyNoJudgeEvaluator.COL_EXPECTED_OUTPUTRagAnswerRelevancyNoJudgeEvaluator.COL_INPUTRagAnswerRelevancyNoJudgeEvaluator.COL_MODELRagAnswerRelevancyNoJudgeEvaluator.COL_SCORERagAnswerRelevancyNoJudgeEvaluator.METRIC_ANSWER_RELEVANCYRagAnswerRelevancyNoJudgeEvaluator.check_compatibility()RagAnswerRelevancyNoJudgeEvaluator.evaluate()RagAnswerRelevancyNoJudgeEvaluator.get_result()RagAnswerRelevancyNoJudgeEvaluator.setup()RagAnswerRelevancyNoJudgeEvaluator.split_sentences()
- h2o_sonar.evaluators.rag_answer_similarity_evaluator module
- h2o_sonar.evaluators.rag_chunk_relevancy_evaluator module
ContextChunkRelevancyEvaluatorContextChunkRelevancyEvaluator.COL_ACTUAL_OUTPUTContextChunkRelevancyEvaluator.COL_CONTEXTContextChunkRelevancyEvaluator.COL_EXPECTED_OUTPUTContextChunkRelevancyEvaluator.COL_INPUTContextChunkRelevancyEvaluator.COL_MODELContextChunkRelevancyEvaluator.COL_SCOREContextChunkRelevancyEvaluator.METRIC_PRECISION_RELEVANCYContextChunkRelevancyEvaluator.METRIC_RECALL_RELEVANCYContextChunkRelevancyEvaluator.check_compatibility()ContextChunkRelevancyEvaluator.evaluate()ContextChunkRelevancyEvaluator.get_result()ContextChunkRelevancyEvaluator.setup()ContextChunkRelevancyEvaluator.split_sentences()
- h2o_sonar.evaluators.rag_context_precision_evaluator module
- h2o_sonar.evaluators.rag_context_recall_evaluator module
- h2o_sonar.evaluators.rag_context_relevancy_evaluator module
- h2o_sonar.evaluators.rag_faithfulness_evaluator module
- h2o_sonar.evaluators.rag_groundedness_evaluator module
RagGroundednessEvaluatorRagGroundednessEvaluator.COL_ACTUAL_OUTPUTRagGroundednessEvaluator.COL_CONTEXTRagGroundednessEvaluator.COL_EXPECTED_OUTPUTRagGroundednessEvaluator.COL_INPUTRagGroundednessEvaluator.COL_MODELRagGroundednessEvaluator.COL_SCORERagGroundednessEvaluator.METRIC_GROUNDEDNESSRagGroundednessEvaluator.check_compatibility()RagGroundednessEvaluator.evaluate()RagGroundednessEvaluator.get_result()RagGroundednessEvaluator.setup()RagGroundednessEvaluator.split_sentences()
- h2o_sonar.evaluators.rag_hallucination_evaluator module
RagHallucinationEvaluatorRagHallucinationEvaluator.COL_ACTUAL_OUTPUTRagHallucinationEvaluator.COL_CONTEXTRagHallucinationEvaluator.COL_EXPECTED_OUTPUTRagHallucinationEvaluator.COL_INPUTRagHallucinationEvaluator.COL_MODELRagHallucinationEvaluator.COL_SCORERagHallucinationEvaluator.DEFAULT_METRIC_THRESHOLDRagHallucinationEvaluator.METRIC_HALLUCINATIONRagHallucinationEvaluator.check_compatibility()RagHallucinationEvaluator.evaluate()RagHallucinationEvaluator.get_result()RagHallucinationEvaluator.setup()
- h2o_sonar.evaluators.rag_ragas_evaluator module
RagasEvaluatorRagasEvaluator.KEY_ANSWERRagasEvaluator.KEY_CONTEXTSRagasEvaluator.KEY_GROUND_TRUTHSRagasEvaluator.KEY_QUESTIONRagasEvaluator.METRIC_ANSWER_CORRECTNESSRagasEvaluator.METRIC_ANSWER_RELEVANCYRagasEvaluator.METRIC_ANSWER_SIMILARITYRagasEvaluator.METRIC_CONTEXT_PRECISIONRagasEvaluator.METRIC_CONTEXT_RECALLRagasEvaluator.METRIC_CONTEXT_RELEVANCYRagasEvaluator.METRIC_FAITHFULNESSRagasEvaluator.METRIC_META_ANSWER_CORRECTNESSRagasEvaluator.METRIC_META_ANSWER_RELEVANCYRagasEvaluator.METRIC_META_ANSWER_SIMILARITYRagasEvaluator.METRIC_META_CONTEXT_PRECISIONRagasEvaluator.METRIC_META_CONTEXT_RECALLRagasEvaluator.METRIC_META_CONTEXT_RELEVANCYRagasEvaluator.METRIC_META_FAITHFULNESSRagasEvaluator.METRIC_META_RAGASRagasEvaluator.METRIC_RAGASRagasEvaluator.check_compatibility()RagasEvaluator.eval_custom_metrics()RagasEvaluator.evaluate()RagasEvaluator.get_result()RagasEvaluator.setup()
- h2o_sonar.evaluators.rag_tokens_presence_evaluator module
- h2o_sonar.evaluators.rouge_evaluator module
- h2o_sonar.evaluators.sensitive_data_leakage_evaluator module
- h2o_sonar.evaluators.sexism_byop_evaluator module
- h2o_sonar.evaluators.stereotype_byop_evaluator module
- h2o_sonar.evaluators.summarization_byop_evaluator module
- h2o_sonar.evaluators.summarization_evaluator module
SummarizationEvaluatorSummarizationEvaluator.KEY_COMPLETENESSSummarizationEvaluator.KEY_FAITHFULNESS_CONVSummarizationEvaluator.KEY_FAITHFULNESS_ZSSummarizationEvaluator.calculate_scores()SummarizationEvaluator.check_compatibility()SummarizationEvaluator.e_model_baai_bgeSummarizationEvaluator.e_model_vitamin_cSummarizationEvaluator.evaluate()SummarizationEvaluator.get_result()SummarizationEvaluator.setup()SummarizationEvaluator.split_sentences()SummarizationEvaluator.summac_faith_score1()SummarizationEvaluator.summac_faith_score2()SummarizationEvaluator.summary_completeness_batch()
load_summac()pairwise_distances_wrapper()segment_calc()
- h2o_sonar.evaluators.toxicity_evaluator module
ToxicityEvaluatorToxicityEvaluator.DEFAULT_TOXICITY_METRIC_THRESHOLDToxicityEvaluator.METRIC_IDENTITY_ATTACKToxicityEvaluator.METRIC_INSULTToxicityEvaluator.METRIC_OBSCENEToxicityEvaluator.METRIC_SEVERE_TOXICITYToxicityEvaluator.METRIC_THREATToxicityEvaluator.METRIC_TOXICITYToxicityEvaluator.check_compatibility()ToxicityEvaluator.evaluate()ToxicityEvaluator.get_result()ToxicityEvaluator.setup()
- h2o_sonar.evaluators.abc_byop_evaluator module
- Module contents
- Submodules
- h2o_sonar.lib package
- Subpackages
- h2o_sonar.lib.api package
- Submodules
- h2o_sonar.lib.api.commons module
BrandingCommonInterpretationParamsCommonInterpretationParams.PARAM_DATASETCommonInterpretationParams.PARAM_DROP_COLSCommonInterpretationParams.PARAM_MODELCommonInterpretationParams.PARAM_MODELSCommonInterpretationParams.PARAM_PREDICTION_COLCommonInterpretationParams.PARAM_RESULTS_LOCATIONCommonInterpretationParams.PARAM_SAMPLE_NUM_ROWSCommonInterpretationParams.PARAM_TARGET_COLCommonInterpretationParams.PARAM_TESTSETCommonInterpretationParams.PARAM_USED_FEATURESCommonInterpretationParams.PARAM_USE_RAW_FEATURESCommonInterpretationParams.PARAM_VALIDSETCommonInterpretationParams.PARAM_WEIGHT_COLCommonInterpretationParams.clone()CommonInterpretationParams.describe_config_item()CommonInterpretationParams.describe_config_items()CommonInterpretationParams.dump()CommonInterpretationParams.load()CommonInterpretationParams.to_dict()
ConfigItemEvaluatorParamTypeEvaluatorToRunExperimentTypeExplainerFilterExplainerJobStatusExplainerJobStatus.ABORTED_BY_RESTARTExplainerJobStatus.ABORTED_BY_USERExplainerJobStatus.CANCELLEDExplainerJobStatus.FAILEDExplainerJobStatus.FINISHEDExplainerJobStatus.IN_PROGRESSExplainerJobStatus.RUNNINGExplainerJobStatus.SCHEDULEDExplainerJobStatus.SUCCESSExplainerJobStatus.SYNCINGExplainerJobStatus.TIMED_OUTExplainerJobStatus.UNKNOWNExplainerJobStatus.from_int()ExplainerJobStatus.is_job_failed()ExplainerJobStatus.is_job_finished()ExplainerJobStatus.is_job_running()ExplainerJobStatus.to_string()
ExplainerParamKeyExplainerParamKey.KEY_ALL_EXPLAINERS_PARAMSExplainerParamKey.KEY_DATASETExplainerParamKey.KEY_DESCR_PATHExplainerParamKey.KEY_EXPERIMENT_TYPEExplainerParamKey.KEY_E_DEPSExplainerParamKey.KEY_E_IDExplainerParamKey.KEY_E_JOB_KEYExplainerParamKey.KEY_E_PARAMSExplainerParamKey.KEY_FEATURES_METAExplainerParamKey.KEY_I_DATA_PATHExplainerParamKey.KEY_KWARGSExplainerParamKey.KEY_LEGACY_I_PARAMSExplainerParamKey.KEY_MODELExplainerParamKey.KEY_MODEL_TYPEExplainerParamKey.KEY_ON_DEMANDExplainerParamKey.KEY_ON_DEMAND_MLI_KEYExplainerParamKey.KEY_ON_DEMAND_PARAMSExplainerParamKey.KEY_PARAMSExplainerParamKey.KEY_RUN_KEYExplainerParamKey.KEY_TESTSETExplainerParamKey.KEY_USERExplainerParamKey.KEY_VALIDSETExplainerParamKey.KEY_WORKER_NAME
ExplainerParamTypeExplainerToRunExplanationScopeFilterEntryInterpretationParamTypeKeywordKeywordGroupKeywordGroupsLlmModelHostTypeLookAndFeelLookAndFeel.BLUE_THEMELookAndFeel.COLORMAP_BLUE_2_REDLookAndFeel.COLORMAP_WHITE_2_BLACKLookAndFeel.COLORMAP_YELLOW_2_BLACKLookAndFeel.COLOR_BLACKLookAndFeel.COLOR_DAI_GREENLookAndFeel.COLOR_H2OAI_YELLOWLookAndFeel.COLOR_HOT_ORANGELookAndFeel.COLOR_MATPLOTLIB_BLUELookAndFeel.COLOR_REDLookAndFeel.COLOR_WHITELookAndFeel.DRIVERLESS_AI_THEMELookAndFeel.FORMAT_HEXALookAndFeel.H2O_SONAR_THEMELookAndFeel.KEY_LFLookAndFeel.THEME_2_BG_COLORLookAndFeel.THEME_2_COLORMAPLookAndFeel.THEME_2_FG_COLORLookAndFeel.THEME_2_LINE_COLORLookAndFeel.get_bg_color()LookAndFeel.get_colormap()LookAndFeel.get_fg_color()LookAndFeel.get_line_color()
MetricMetaMetricMeta.DATA_TYPE_SECONDSMetricMeta.EFFECTIVE_INF_FLOATMetricMeta.EFFECTIVE_INF_FLOAT_INTMetricMeta.EFFECTIVE_INF_INTMetricMeta.KEY_DATA_TYPEMetricMeta.KEY_DESCRIPTIONMetricMeta.KEY_DISPLAY_FORMATMetricMeta.KEY_DISPLAY_NAMEMetricMeta.KEY_EXCLUDEMetricMeta.KEY_HIGHER_IS_BETTERMetricMeta.KEY_IS_PRIMARY_METRICMetricMeta.KEY_KEYMetricMeta.KEY_PARENT_METRICMetricMeta.KEY_THRESHOLDMetricMeta.KEY_VALUE_ENUMMetricMeta.KEY_VALUE_RANGEMetricMeta.clone()MetricMeta.copy()MetricMeta.dump()MetricMeta.from_dict()MetricMeta.is_metric_flip()MetricMeta.load()MetricMeta.to_dict()MetricMeta.to_md()
MetricsMetaMetricsMeta.KEY_METAMetricsMeta.add_metric()MetricsMeta.clone()MetricsMeta.contains()MetricsMeta.copy_with_overrides()MetricsMeta.dump()MetricsMeta.from_dict()MetricsMeta.get_metric()MetricsMeta.get_metric_best_value()MetricsMeta.get_metric_description()MetricsMeta.get_metric_keys()MetricsMeta.get_metric_worst_value()MetricsMeta.get_primary_metric()MetricsMeta.get_threshold()MetricsMeta.is_higher_better()MetricsMeta.is_metric_passed()MetricsMeta.load()MetricsMeta.make_portable()MetricsMeta.set_threshold()MetricsMeta.size()MetricsMeta.to_dict()MetricsMeta.to_list()
MimeTypeMimeType.EXT_CSVMimeType.EXT_DATATABLEMimeType.EXT_DOCXMimeType.EXT_HTMLMimeType.EXT_JPGMimeType.EXT_JSONMimeType.EXT_MARKDOWNMimeType.EXT_PNGMimeType.EXT_SVGMimeType.EXT_TEXTMimeType.EXT_ZIPMimeType.MIME_CSVMimeType.MIME_DATATABLEMimeType.MIME_DOCXMimeType.MIME_EVALSTUDIO_MARKDOWNMimeType.MIME_HTMLMimeType.MIME_IMAGEMimeType.MIME_JPGMimeType.MIME_JSONMimeType.MIME_JSON_CSVMimeType.MIME_JSON_DATATABLEMimeType.MIME_MARKDOWNMimeType.MIME_MODEL_PIPELINEMimeType.MIME_PDFMimeType.MIME_PNGMimeType.MIME_SVGMimeType.MIME_TEXTMimeType.MIME_ZIPMimeType.ext_for_mime()
ModelTypeExplanationParamParamTypePerturbationIntensityPerturbatorToRunResourceHandleResourceLocatorTypeSafeJavaScriptSemVerUpdateGlobalExplanationUpdateGlobalExplanation.OPT_CLASSUpdateGlobalExplanation.OPT_FEATUREUpdateGlobalExplanation.OPT_INHERITUpdateGlobalExplanation.OPT_MERGEUpdateGlobalExplanation.OPT_REPLACEUpdateGlobalExplanation.OPT_REQUESTUpdateGlobalExplanation.PARAMS_SOURCEUpdateGlobalExplanation.UPDATE_MODEUpdateGlobalExplanation.UPDATE_SCOPE
add_string_list()base_pkg()generate_key()harmonic_mean()is_ncname()is_port_used()is_valid_key()opt_import_err_msg()port_float()raise_opt_import_err()
- h2o_sonar.lib.api.datasets module
- h2o_sonar.lib.api.explainers module
ExplainerExplainer.ARG_EXPLAINER_PARAMSExplainer.EXPLAINERS_PURPOSESExplainer.KEYWORD_COMPLIANCE_TESTExplainer.KEYWORD_DEFAULTExplainer.KEYWORD_EVALUATES_LLMExplainer.KEYWORD_EVALUATES_RAGExplainer.KEYWORD_EXPLAINS_APPROX_BEHAVIORExplainer.KEYWORD_EXPLAINS_DATASETExplainer.KEYWORD_EXPLAINS_FAIRNESSExplainer.KEYWORD_EXPLAINS_FEATURE_BEHAVIORExplainer.KEYWORD_EXPLAINS_MODEL_DEBUGGINGExplainer.KEYWORD_EXPLAINS_O_FEATURE_IMPORTANCEExplainer.KEYWORD_EXPLAINS_T_FEATURE_IMPORTANCEExplainer.KEYWORD_EXPLAINS_UNKNOWNExplainer.KEYWORD_H2O_MODEL_VALIDATIONExplainer.KEYWORD_H2O_SONARExplainer.KEYWORD_IS_FASTExplainer.KEYWORD_IS_SLOWExplainer.KEYWORD_LLMExplainer.KEYWORD_MOCKExplainer.KEYWORD_NLPExplainer.KEYWORD_PREFIX_CAPABILITYExplainer.KEYWORD_PREFIX_EXPLAINSExplainer.KEYWORD_PROXYExplainer.KEYWORD_REQUIRES_H2O3Explainer.KEYWORD_REQUIRES_OPENAI_KEYExplainer.KEYWORD_RQ_AAExplainer.KEYWORD_RQ_CExplainer.KEYWORD_RQ_EAExplainer.KEYWORD_RQ_JExplainer.KEYWORD_RQ_PExplainer.KEYWORD_RQ_RCExplainer.KEYWORD_TEMPLATEExplainer.KEYWORD_UNLISTEDExplainer.add_insight()Explainer.add_problem()Explainer.as_descriptor()Explainer.brief_descriptionExplainer.can_explain()Explainer.check_compatibility()Explainer.check_required_modules()Explainer.class_brief_description()Explainer.class_description()Explainer.class_display_name()Explainer.class_nameExplainer.class_tagline()Explainer.create_explanation_workdir_archive()Explainer.dataset_apiExplainer.dataset_metaExplainer.dependenciesExplainer.depends_on()Explainer.descriptionExplainer.destroy()Explainer.display_nameExplainer.evaluator_id()Explainer.expected_custom_classExplainer.explain()Explainer.explain_global()Explainer.explain_insights()Explainer.explain_local()Explainer.explain_problems()Explainer.explainer_depsExplainer.explainer_id()Explainer.explainer_paramsExplainer.explainer_params_as_dict()Explainer.explainer_params_as_strExplainer.explainer_version()Explainer.explains_binary()Explainer.explains_multiclass()Explainer.explains_regression()Explainer.explanationsExplainer.fit()Explainer.get_explanations()Explainer.get_result()Explainer.has_explanation_scopes()Explainer.has_explanation_types()Explainer.has_explanations()Explainer.has_model_type_explanations()Explainer.is_enabled()Explainer.is_iid()Explainer.is_image()Explainer.is_llm()Explainer.is_rag()Explainer.is_time_series()Explainer.is_unsupervised()Explainer.keyExplainer.keywordsExplainer.load()Explainer.load_descriptor()Explainer.log_nameExplainer.loggerExplainer.metrics_meta()Explainer.mli_keyExplainer.modelExplainer.model_apiExplainer.model_metaExplainer.parameters()Explainer.paramsExplainer.persistenceExplainer.priority()Explainer.report_progress()Explainer.requires_model()Explainer.requires_predict_method()Explainer.requires_preloaded_predictor()Explainer.run_explain()Explainer.run_explain_global()Explainer.run_explain_local()Explainer.run_fit()Explainer.save()Explainer.save_descriptor()Explainer.setup()Explainer.supports_dataset_locator()Explainer.supports_model_locator()Explainer.taglineExplainer.testset_metaExplainer.validate_explanations()Explainer.validset_metaExplainer.working_dir
ExplainerArgsExplainerArgs.add_parameter()ExplainerArgs.as_descriptor()ExplainerArgs.from_config_overrides()ExplainerArgs.from_dict()ExplainerArgs.get()ExplainerArgs.json_str_to_dict()ExplainerArgs.parametersExplainerArgs.resolve_local_paging_args()ExplainerArgs.resolve_params()ExplainerArgs.toml_str_to_dict()
ExplainerDescriptorExplainerDescriptor.KEY_BRIEF_DESCRIPTIONExplainerDescriptor.KEY_CAN_EXPLAINExplainerDescriptor.KEY_DESCRIPTIONExplainerDescriptor.KEY_DISPLAY_NAMEExplainerDescriptor.KEY_EXPLANATIONSExplainerDescriptor.KEY_EXPLANATION_SCOPESExplainerDescriptor.KEY_IDExplainerDescriptor.KEY_KEYWORDSExplainerDescriptor.KEY_METRICS_METAExplainerDescriptor.KEY_MODEL_TYPESExplainerDescriptor.KEY_NAMEExplainerDescriptor.KEY_PARAMETERSExplainerDescriptor.KEY_TAGLINEExplainerDescriptor.clone()ExplainerDescriptor.dump()ExplainerDescriptor.load()
ExplainerParamExplainerRegistryExplainerResultOnDemandExplainKeyOnDemandExplainMethodSurrogateExplainer
- h2o_sonar.lib.api.explanations module
- h2o_sonar.lib.api.formats module
CsvFormatCustomExplanationFormatCustomArchiveZipFormatCustomCsvFormatCustomJsonFormatDatatableCustomExplanationFormatDiaTextFormatDocxFormatEvalStudioMarkdownFormatExplanationFormatExplanationFormat.DEFAULT_PAGE_SIZEExplanationFormat.FEATURE_TYPE_CATExplanationFormat.FEATURE_TYPE_CAT_NUMExplanationFormat.FEATURE_TYPE_DATEExplanationFormat.FEATURE_TYPE_DATETIMEExplanationFormat.FEATURE_TYPE_NUMExplanationFormat.FEATURE_TYPE_TIMEExplanationFormat.FILE_PREFIX_EXPLANATION_IDXExplanationFormat.KEYWORD_RESIDUALSExplanationFormat.KEY_ACTIONExplanationFormat.KEY_ACTION_TYPEExplanationFormat.KEY_ACTUALExplanationFormat.KEY_BIASExplanationFormat.KEY_CATEGORICALExplanationFormat.KEY_DATAExplanationFormat.KEY_DATA_HISTOGRAMExplanationFormat.KEY_DATA_HISTOGRAM_CATExplanationFormat.KEY_DATA_HISTOGRAM_NUMExplanationFormat.KEY_DATEExplanationFormat.KEY_DATE_TIMEExplanationFormat.KEY_DEFAULT_CLASSExplanationFormat.KEY_DOCExplanationFormat.KEY_EXPLAINER_JOB_KEYExplanationFormat.KEY_FEATURESExplanationFormat.KEY_FEATURE_TYPEExplanationFormat.KEY_FEATURE_VALUEExplanationFormat.KEY_FILESExplanationFormat.KEY_FILES_DETAILSExplanationFormat.KEY_FILES_NUMCAT_ASPECTExplanationFormat.KEY_FULLNAMEExplanationFormat.KEY_IDExplanationFormat.KEY_IS_MULTIExplanationFormat.KEY_ITEM_ORDERExplanationFormat.KEY_KEYWORDSExplanationFormat.KEY_LABELExplanationFormat.KEY_METADATAExplanationFormat.KEY_METRICSExplanationFormat.KEY_MIMEExplanationFormat.KEY_MLI_KEYExplanationFormat.KEY_NAMEExplanationFormat.KEY_NUMERICExplanationFormat.KEY_ON_DEMANDExplanationFormat.KEY_ON_DEMAND_PARAMSExplanationFormat.KEY_PAGE_OFFSETExplanationFormat.KEY_PAGE_SIZEExplanationFormat.KEY_RAW_FEATURESExplanationFormat.KEY_ROWS_PER_PAGEExplanationFormat.KEY_RUNNING_ACTIONExplanationFormat.KEY_SCOPEExplanationFormat.KEY_SYNC_ON_DEMANDExplanationFormat.KEY_TIMEExplanationFormat.KEY_TOTAL_ROWSExplanationFormat.KEY_VALUEExplanationFormat.KEY_Y_FILEExplanationFormat.LABEL_REGRESSIONExplanationFormat.SCOPE_GLOBALExplanationFormat.SCOPE_LOCALExplanationFormat.add_data()ExplanationFormat.add_file()ExplanationFormat.explanationExplanationFormat.file_namesExplanationFormat.get_data()ExplanationFormat.get_local_explanation()ExplanationFormat.get_page()ExplanationFormat.index_file_nameExplanationFormat.is_on_demand()ExplanationFormat.is_paged()ExplanationFormat.load_meta()ExplanationFormat.mimeExplanationFormat.update_data()
ExplanationFormatUtilsGlobal3dDataJSonCsvFormatGlobal3dDataJSonFormatGlobalDtJSonFormatGlobalDtJSonFormat.KEY_CHILDRENGlobalDtJSonFormat.KEY_EDGE_INGlobalDtJSonFormat.KEY_EDGE_WEIGHTGlobalDtJSonFormat.KEY_KEYGlobalDtJSonFormat.KEY_LEAF_PATHGlobalDtJSonFormat.KEY_NAMEGlobalDtJSonFormat.KEY_PARENTGlobalDtJSonFormat.KEY_TOTAL_WEIGHTGlobalDtJSonFormat.KEY_WEIGHTGlobalDtJSonFormat.TreeNodeGlobalDtJSonFormat.load_index_file()GlobalDtJSonFormat.mimeGlobalDtJSonFormat.serialize_data_file()GlobalDtJSonFormat.serialize_index_file()GlobalDtJSonFormat.validate_data()
GlobalFeatImpDatatableFormatGlobalFeatImpJSonCsvFormatGlobalFeatImpJSonDatatableFormatGlobalFeatImpJSonDatatableFormat.COL_GLOBAL_SCOPEGlobalFeatImpJSonDatatableFormat.COL_IMPORTANCEGlobalFeatImpJSonDatatableFormat.COL_NAMEGlobalFeatImpJSonDatatableFormat.add_data_frame()GlobalFeatImpJSonDatatableFormat.dict_to_data_frame()GlobalFeatImpJSonDatatableFormat.from_lists()GlobalFeatImpJSonDatatableFormat.get_data()GlobalFeatImpJSonDatatableFormat.get_page()GlobalFeatImpJSonDatatableFormat.is_paged()GlobalFeatImpJSonDatatableFormat.mimeGlobalFeatImpJSonDatatableFormat.serialize_index_file()GlobalFeatImpJSonDatatableFormat.validate_data()
GlobalFeatImpJSonFormatGlobalFeatImpJSonFormat.KEY_LABELGlobalFeatImpJSonFormat.KEY_VALUEGlobalFeatImpJSonFormat.from_dataframe_to_json()GlobalFeatImpJSonFormat.from_json_datatable()GlobalFeatImpJSonFormat.get_global_explanation()GlobalFeatImpJSonFormat.load_index_file()GlobalFeatImpJSonFormat.mimeGlobalFeatImpJSonFormat.serialize_data_file()GlobalFeatImpJSonFormat.serialize_index_file()GlobalFeatImpJSonFormat.validate_data()
GlobalGroupedBarChartJSonDatatableFormatGlobalGroupedBarChartJSonDatatableFormat.COL_XGlobalGroupedBarChartJSonDatatableFormat.COL_Y_GROUP_1GlobalGroupedBarChartJSonDatatableFormat.COL_Y_GROUP_2GlobalGroupedBarChartJSonDatatableFormat.add_data_frame()GlobalGroupedBarChartJSonDatatableFormat.get_data()GlobalGroupedBarChartJSonDatatableFormat.is_paged()GlobalGroupedBarChartJSonDatatableFormat.load_index_file()GlobalGroupedBarChartJSonDatatableFormat.mimeGlobalGroupedBarChartJSonDatatableFormat.serialize_index_file()GlobalGroupedBarChartJSonDatatableFormat.validate_data()
GlobalLinePlotJSonFormatGlobalNlpLocoJSonFormatGlobalNlpLocoJSonFormat.FILTER_TYPE_TEXT_FEATURESGlobalNlpLocoJSonFormat.KEY_DESCRIPTIONGlobalNlpLocoJSonFormat.KEY_FILTERSGlobalNlpLocoJSonFormat.KEY_LABELGlobalNlpLocoJSonFormat.KEY_NAMEGlobalNlpLocoJSonFormat.KEY_TYPEGlobalNlpLocoJSonFormat.KEY_VALUEGlobalNlpLocoJSonFormat.KEY_VALUESGlobalNlpLocoJSonFormat.from_dataframe_to_json()GlobalNlpLocoJSonFormat.from_json_datatable()GlobalNlpLocoJSonFormat.get_global_explanation()GlobalNlpLocoJSonFormat.get_page()GlobalNlpLocoJSonFormat.is_paged()GlobalNlpLocoJSonFormat.load_index_file()GlobalNlpLocoJSonFormat.mimeGlobalNlpLocoJSonFormat.serialize_data_file()GlobalNlpLocoJSonFormat.serialize_index_file()GlobalNlpLocoJSonFormat.validate_data()
GlobalScatterPlotJSonFormatGlobalSummaryFeatImpJsonDatatableFormatGlobalSummaryFeatImpJsonDatatableFormat.KEY_FEATUREGlobalSummaryFeatImpJsonDatatableFormat.KEY_FREQUENCYGlobalSummaryFeatImpJsonDatatableFormat.KEY_HIGH_VALUEGlobalSummaryFeatImpJsonDatatableFormat.KEY_ORDERGlobalSummaryFeatImpJsonDatatableFormat.KEY_SHAPLEYGlobalSummaryFeatImpJsonDatatableFormat.add_data_frame()GlobalSummaryFeatImpJsonDatatableFormat.load_index_file()GlobalSummaryFeatImpJsonDatatableFormat.mimeGlobalSummaryFeatImpJsonDatatableFormat.serialize_index_file()GlobalSummaryFeatImpJsonDatatableFormat.validate_data()
GlobalSummaryFeatImpJsonFormatGlobalSummaryFeatImpJsonFormat.DATA_FILE_PREFIXGlobalSummaryFeatImpJsonFormat.DEFAULT_PAGE_SIZEGlobalSummaryFeatImpJsonFormat.KEY_FEATUREGlobalSummaryFeatImpJsonFormat.KEY_FEATURES_PER_PAGEGlobalSummaryFeatImpJsonFormat.KEY_FREQUENCYGlobalSummaryFeatImpJsonFormat.KEY_HIGH_VALUEGlobalSummaryFeatImpJsonFormat.KEY_ORDERGlobalSummaryFeatImpJsonFormat.KEY_SHAPLEYGlobalSummaryFeatImpJsonFormat.from_json_datatable()GlobalSummaryFeatImpJsonFormat.get_page()GlobalSummaryFeatImpJsonFormat.is_paged()GlobalSummaryFeatImpJsonFormat.load_index_file()GlobalSummaryFeatImpJsonFormat.mimeGlobalSummaryFeatImpJsonFormat.serialize_data_file()GlobalSummaryFeatImpJsonFormat.serialize_index_file()GlobalSummaryFeatImpJsonFormat.validate_data()
GrammarOfMliFormatHtmlFormatIceCsvFormatIceDatatableFormatIceJsonDatatableFormatIceJsonDatatableFormat.FILE_Y_FILEIceJsonDatatableFormat.KEY_BINIceJsonDatatableFormat.KEY_BINSIceJsonDatatableFormat.KEY_BINS_NUMCAT_ASPECTIceJsonDatatableFormat.KEY_COL_NAMEIceJsonDatatableFormat.KEY_FEATURE_VALUEIceJsonDatatableFormat.KEY_ICEIceJsonDatatableFormat.KEY_PREDICTIONIceJsonDatatableFormat.add_data_frame()IceJsonDatatableFormat.get_local_explanation()IceJsonDatatableFormat.is_on_demand()IceJsonDatatableFormat.load_index_file()IceJsonDatatableFormat.merge_format()IceJsonDatatableFormat.mimeIceJsonDatatableFormat.mli_ice_explanation_to_json()IceJsonDatatableFormat.serialize_index_file()IceJsonDatatableFormat.serialize_on_demand_index_file()IceJsonDatatableFormat.validate_data()
LlmHeatmapLeaderboardJSonFormatLlmLeaderboardJSonFormatLocalDtJSonFormatLocalDtJSonFormat.dt_path_to_node_key()LocalDtJSonFormat.dt_set_tree_path()LocalDtJSonFormat.get_local_explanation()LocalDtJSonFormat.is_on_demand()LocalDtJSonFormat.mimeLocalDtJSonFormat.serialize_index_file()LocalDtJSonFormat.serialize_on_demand_index_file()LocalDtJSonFormat.validate_data()
LocalFeatImpDatatableFormatLocalFeatImpJSonDatatableFormatLocalFeatImpJSonFormatLocalFeatImpJSonFormat.KEY_YLocalFeatImpJSonFormat.is_on_demand()LocalFeatImpJSonFormat.load_index_file()LocalFeatImpJSonFormat.merge_local_and_global_page()LocalFeatImpJSonFormat.mimeLocalFeatImpJSonFormat.serialize_index_file()LocalFeatImpJSonFormat.sort_data()LocalFeatImpJSonFormat.validate_data()
LocalFeatImpWithYhatsJSonDatatableFormatLocalNlpLocoJSonFormatLocalOnDemandHtmlFormatLocalOnDemandTextFormatLocalSummaryFeatImplJSonFormatLocalSummaryFeatImplJSonFormat.is_on_demand()LocalSummaryFeatImplJSonFormat.is_paged()LocalSummaryFeatImplJSonFormat.load_index_file()LocalSummaryFeatImplJSonFormat.mimeLocalSummaryFeatImplJSonFormat.serialize_index_file()LocalSummaryFeatImplJSonFormat.serialize_on_demand_index_file()LocalSummaryFeatImplJSonFormat.validate_data()
MarkdownFormatModelValidationResultArchiveFormatPartialDependenceCsvFormatPartialDependenceDatatableFormatPartialDependenceDatatableFormat.COL_BIN_VALUEPartialDependenceDatatableFormat.COL_F_LTYPEPartialDependenceDatatableFormat.COL_F_NAMEPartialDependenceDatatableFormat.COL_IS_OORPartialDependenceDatatableFormat.COL_MEANPartialDependenceDatatableFormat.COL_SDPartialDependenceDatatableFormat.COL_SEMPartialDependenceDatatableFormat.mimePartialDependenceDatatableFormat.validate_data()
PartialDependenceJSonFormatPartialDependenceJSonFormat.KEY_BINPartialDependenceJSonFormat.KEY_FREQUENCYPartialDependenceJSonFormat.KEY_OORPartialDependenceJSonFormat.KEY_PDPartialDependenceJSonFormat.KEY_SDPartialDependenceJSonFormat.KEY_XPartialDependenceJSonFormat.get_bins()PartialDependenceJSonFormat.get_numcat_aspects()PartialDependenceJSonFormat.get_numcat_missing_aspect()PartialDependenceJSonFormat.load_index_file()PartialDependenceJSonFormat.merge_format()PartialDependenceJSonFormat.mimePartialDependenceJSonFormat.serialize_index_file()PartialDependenceJSonFormat.set_merge_status()PartialDependenceJSonFormat.validate_data()
SaTextFormatTextCustomExplanationFormatTextCustomExplanationFormat.FILE_IS_ON_DEMANDTextCustomExplanationFormat.FILTER_CLASSTextCustomExplanationFormat.FILTER_FEATURETextCustomExplanationFormat.FILTER_NUMCATTextCustomExplanationFormat.add_data()TextCustomExplanationFormat.add_file()TextCustomExplanationFormat.get_data()TextCustomExplanationFormat.is_on_demand()TextCustomExplanationFormat.mimeTextCustomExplanationFormat.set_index_commons()TextCustomExplanationFormat.set_on_demand()TextCustomExplanationFormat.update_index_file()
TextFormatWorkDirArchiveZipFormatget_custom_explanation_formats()
- h2o_sonar.lib.api.interpretations module
ExplainerJobExplainerJob.KEY_CHILD_KEYSExplainerJob.KEY_CREATEDExplainerJob.KEY_DURATIONExplainerJob.KEY_ERRORExplainerJob.KEY_EXPLAINER_DESCRIPTORExplainerJob.KEY_JOB_LOCATIONExplainerJob.KEY_KEYExplainerJob.KEY_MESSAGEExplainerJob.KEY_PROGRESSExplainerJob.KEY_RESULT_DESCRIPTORExplainerJob.KEY_STATUSExplainerJob.evaluator_id()ExplainerJob.explainer_id()ExplainerJob.from_dict()ExplainerJob.is_finished()ExplainerJob.success()ExplainerJob.tick()ExplainerJob.to_dict()
HtmlInterpretationFormatHtmlInterpretationFormat.ContextHtmlInterpretationFormat.Context.clear()HtmlInterpretationFormat.Context.explainers_by_purposeHtmlInterpretationFormat.Context.get_purpose_representatives_job_keys()HtmlInterpretationFormat.Context.purpose_imageHtmlInterpretationFormat.Context.purpose_representativeHtmlInterpretationFormat.Context.purposes_w_repre
HtmlInterpretationFormat.KEYWORD_ID_2_NAMEHtmlInterpretationFormat.html_footer()HtmlInterpretationFormat.html_h2o_sonar_pitch()HtmlInterpretationFormat.html_safe_str_field()HtmlInterpretationFormat.to_html()
HtmlInterpretationsFormatInterpretationInterpretation.KEY_ALL_EXPLAINERSInterpretation.KEY_CREATEDInterpretation.KEY_DATASETInterpretation.KEY_ERRORInterpretation.KEY_EXECUTED_EXPLAINERSInterpretation.KEY_EXPLAINERSInterpretation.KEY_E_PARAMSInterpretation.KEY_INCOMPATIBLE_EXPLAINERSInterpretation.KEY_INCOMPATIBLE_EXPLAINERS_DSInterpretation.KEY_INSIGHTSInterpretation.KEY_INTERPRETATION_LOCATIONInterpretation.KEY_I_KEYInterpretation.KEY_I_PARAMSInterpretation.KEY_MODELInterpretation.KEY_MODELSInterpretation.KEY_OVERALL_RESULTInterpretation.KEY_PROBLEMSInterpretation.KEY_PROGRESSInterpretation.KEY_PROGRESS_MESSAGEInterpretation.KEY_RESULTInterpretation.KEY_RESULTS_LOCATIONInterpretation.KEY_SCHEDULED_EXPLAINERSInterpretation.KEY_STATUSInterpretation.KEY_TARGET_COLInterpretation.KEY_TESTSETInterpretation.KEY_VALIDSETInterpretation.dict_to_digest()Interpretation.errorInterpretation.explainer_resultsInterpretation.get_all_explainer_ids()Interpretation.get_explainer_ids_by_status()Interpretation.get_explainer_insights()Interpretation.get_explainer_jobs_by_status()Interpretation.get_explainer_problems()Interpretation.get_explainer_result()Interpretation.get_explainer_result_metadata()Interpretation.get_explanation_file_path()Interpretation.get_failed_explainer_ids()Interpretation.get_finished_explainer_ids()Interpretation.get_incompatible_explainer_ids()Interpretation.get_insights()Interpretation.get_jobs_for_evaluator_id()Interpretation.get_jobs_for_explainer_id()Interpretation.get_model_insights()Interpretation.get_model_problems()Interpretation.get_problems_by_severity()Interpretation.get_scheduled_explainer_ids()Interpretation.get_successful_explainer_ids()Interpretation.html_formatInterpretation.is_evaluator_failed()Interpretation.is_evaluator_finished()Interpretation.is_evaluator_scheduled()Interpretation.is_evaluator_successful()Interpretation.is_explainer_failed()Interpretation.is_explainer_finished()Interpretation.is_explainer_scheduled()Interpretation.is_explainer_successful()Interpretation.is_finished()Interpretation.load()Interpretation.load_from_json()Interpretation.pdf_formatInterpretation.persistenceInterpretation.progressInterpretation.progress_messageInterpretation.register_explainer_result()Interpretation.set_progress()Interpretation.statusInterpretation.to_dict()Interpretation.to_html()Interpretation.to_html_4_pdf()Interpretation.to_json()Interpretation.to_pdf()Interpretation.update_overall_result()Interpretation.validate_and_normalize_params()
InterpretationResultInterpretationResult.all_explainer_idsInterpretationResult.explainer_idsInterpretationResult.explainersInterpretationResult.get_evaluator_job()InterpretationResult.get_evaluator_jobs()InterpretationResult.get_explainer_job()InterpretationResult.get_explainer_jobs()InterpretationResult.get_html_report_location()InterpretationResult.get_interpretation_dir_location()InterpretationResult.get_interpretations_html_index_location()InterpretationResult.get_json_report_location()InterpretationResult.get_pdf_report_location()InterpretationResult.get_progress_location()InterpretationResult.get_results_dir_location()InterpretationResult.incompatible_explainer_idsInterpretationResult.incompatible_explainersInterpretationResult.insightsInterpretationResult.make_zip_archive()InterpretationResult.modelsInterpretationResult.overall_resultInterpretationResult.problemsInterpretationResult.remove_duplicate_insights()InterpretationResult.to_dict()InterpretationResult.to_json()InterpretationResult.upload_url
InterpretationsOverallResultPdfInterpretationFormat
- h2o_sonar.lib.api.judges module
- h2o_sonar.lib.api.models module
DriverlessAiModelDriverlessAiRestServerModelExplainableLlmModelExplainableLlmModel.KEY_CONNECTIONExplainableLlmModel.KEY_H2OGPTE_STATSExplainableLlmModel.KEY_H2OGPTE_VISION_MExplainableLlmModel.KEY_KEYExplainableLlmModel.KEY_LLM_MODEL_METAExplainableLlmModel.KEY_LLM_MODEL_NAMEExplainableLlmModel.KEY_MODEL_CFGExplainableLlmModel.KEY_MODEL_TYPEExplainableLlmModel.KEY_NAMEExplainableLlmModel.KEY_STATS_DURATIONExplainableLlmModel.KEY_STATS_FAILUREExplainableLlmModel.KEY_STATS_RETRYExplainableLlmModel.KEY_STATS_SUCCESSExplainableLlmModel.KEY_STATS_TIMEOUTExplainableLlmModel.clone()ExplainableLlmModel.from_dict()ExplainableLlmModel.to_dict()ExplainableLlmModel.to_json()
ExplainableModelExplainableModel.fit()ExplainableModel.has_transformed_modelExplainableModel.load()ExplainableModel.metaExplainableModel.predict()ExplainableModel.predict_datatable()ExplainableModel.predict_pandas()ExplainableModel.save()ExplainableModel.shapley_values()ExplainableModel.to_dict()ExplainableModel.to_json()ExplainableModel.transformed_model
ExplainableModelHandleExplainableModelMetaExplainableModelMeta.default_feature_importances()ExplainableModelMeta.feature_importancesExplainableModelMeta.features_metadataExplainableModelMeta.get_model_type()ExplainableModelMeta.has_shapley_valuesExplainableModelMeta.has_text_transformersExplainableModelMeta.is_constantExplainableModelMeta.num_labelsExplainableModelMeta.positive_label_of_interestExplainableModelMeta.to_dict()ExplainableModelMeta.to_json()ExplainableModelMeta.transformed_featuresExplainableModelMeta.used_features
ExplainableModelTypeExplainableModelType.amazon_bedrock_ragExplainableModelType.anthropic_llmExplainableModelType.azure_openai_llmExplainableModelType.driverless_aiExplainableModelType.driverless_ai_restExplainableModelType.from_connection_type()ExplainableModelType.h2o3ExplainableModelType.h2ogptExplainableModelType.h2ogpteExplainableModelType.h2ogpte_llmExplainableModelType.h2ollmopsExplainableModelType.is_llm()ExplainableModelType.is_rag()ExplainableModelType.mockExplainableModelType.ollamaExplainableModelType.openai_llmExplainableModelType.openai_ragExplainableModelType.scikit_learnExplainableModelType.to_connection_type()ExplainableModelType.unknown
ExplainableRagModelExplainableRagModel.KEY_COLLECTION_IDExplainableRagModel.KEY_COLLECTION_NAMEExplainableRagModel.KEY_CONNECTIONExplainableRagModel.KEY_DOCUMENTSExplainableRagModel.KEY_KEYExplainableRagModel.KEY_LLM_MODEL_METAExplainableRagModel.KEY_LLM_MODEL_NAMEExplainableRagModel.KEY_MODEL_CFGExplainableRagModel.KEY_MODEL_TYPEExplainableRagModel.KEY_NAMEExplainableRagModel.clone()ExplainableRagModel.from_dict()ExplainableRagModel.to_dict()
H2o3ModelModelApiModelVendorOpenAiRagModelPickleFileModelScikitLearnModelTransformedFeaturesModelexplainable_rag_llm_model_from_json()guess_model_labels()guess_model_used_features()
- h2o_sonar.lib.api.persistences module
ExplainerPersistenceExplainerPersistence.DIR_EXPLAINERExplainerPersistence.DIR_INSIGHTSExplainerPersistence.DIR_LOGExplainerPersistence.DIR_PROBLEMSExplainerPersistence.DIR_WORKExplainerPersistence.EXPLAINER_LOG_PREFIXExplainerPersistence.EXPLAINER_LOG_SUFFIX_ANONExplainerPersistence.FILE_DONE_DONEExplainerPersistence.FILE_DONE_FAILEDExplainerPersistence.FILE_EXPLAINER_PICKLEExplainerPersistence.FILE_EXPLANATIONExplainerPersistence.FILE_INSIGHTSExplainerPersistence.FILE_ON_DEMAND_EXPLANATION_SUFFIXExplainerPersistence.FILE_PROBLEMSExplainerPersistence.FILE_RESULT_DESCRIPTORExplainerPersistence.explainer_idExplainerPersistence.explainer_job_keyExplainerPersistence.get_dirs_for_explainer_id()ExplainerPersistence.get_evaluator_working_file()ExplainerPersistence.get_explainer_ann_log_file()ExplainerPersistence.get_explainer_ann_log_path()ExplainerPersistence.get_explainer_dir()ExplainerPersistence.get_explainer_dir_archive()ExplainerPersistence.get_explainer_insights_dir()ExplainerPersistence.get_explainer_insights_file()ExplainerPersistence.get_explainer_log_dir()ExplainerPersistence.get_explainer_log_file()ExplainerPersistence.get_explainer_log_path()ExplainerPersistence.get_explainer_problems_dir()ExplainerPersistence.get_explainer_problems_file()ExplainerPersistence.get_explainer_working_dir()ExplainerPersistence.get_explainer_working_file()ExplainerPersistence.get_explanation_dir_path()ExplainerPersistence.get_explanation_file_path()ExplainerPersistence.get_explanation_meta_path()ExplainerPersistence.get_key_for_explainer_dir()ExplainerPersistence.get_locators_for_explainer_id()ExplainerPersistence.get_relative_path()ExplainerPersistence.get_result_descriptor_file_path()ExplainerPersistence.load_insights()ExplainerPersistence.load_problems()ExplainerPersistence.load_result_descriptor()ExplainerPersistence.make_dir()ExplainerPersistence.make_explainer_dir()ExplainerPersistence.make_explainer_insights_dir()ExplainerPersistence.make_explainer_log_dir()ExplainerPersistence.make_explainer_problems_dir()ExplainerPersistence.make_explainer_sandbox()ExplainerPersistence.make_explainer_working_dir()ExplainerPersistence.makedirs()ExplainerPersistence.resolve_mli_path()ExplainerPersistence.rm_explainer_dir()ExplainerPersistence.save_insights()ExplainerPersistence.save_json()ExplainerPersistence.save_problems()ExplainerPersistence.username
FilesystemPersistenceFilesystemPersistence.copy_file()FilesystemPersistence.delete()FilesystemPersistence.delete_dir_contents()FilesystemPersistence.delete_file()FilesystemPersistence.delete_tree()FilesystemPersistence.exists()FilesystemPersistence.flush_dir_for_file()FilesystemPersistence.get_default_cwl()FilesystemPersistence.getcwl()FilesystemPersistence.is_dir()FilesystemPersistence.is_file()FilesystemPersistence.list_dir()FilesystemPersistence.list_files_by_wildcard()FilesystemPersistence.load()FilesystemPersistence.load_json()FilesystemPersistence.make_dir()FilesystemPersistence.make_dir_zip_archive()FilesystemPersistence.save()FilesystemPersistence.save_json()FilesystemPersistence.touch()FilesystemPersistence.typeFilesystemPersistence.update()
InMemoryPersistenceInMemoryPersistence.DIRInMemoryPersistence.DirectoryInMemoryPersistence.copy_file()InMemoryPersistence.delete()InMemoryPersistence.delete_dir_contents()InMemoryPersistence.delete_file()InMemoryPersistence.delete_tree()InMemoryPersistence.exists()InMemoryPersistence.get_default_cwl()InMemoryPersistence.getcwl()InMemoryPersistence.is_dir()InMemoryPersistence.is_file()InMemoryPersistence.list_dir()InMemoryPersistence.list_files_by_wildcard()InMemoryPersistence.load()InMemoryPersistence.load_json()InMemoryPersistence.make_dir()InMemoryPersistence.make_dir_zip_archive()InMemoryPersistence.save()InMemoryPersistence.save_json()InMemoryPersistence.touch()InMemoryPersistence.type
InterpretationPersistenceInterpretationPersistence.DIR_AD_HOC_EXPLANATIONInterpretationPersistence.DIR_AUTOML_EXPERIMENTInterpretationPersistence.DIR_MLI_EXPERIMENTInterpretationPersistence.DIR_MLI_TS_EXPERIMENTInterpretationPersistence.FILE_COMMON_PARAMSInterpretationPersistence.FILE_EXPERIMENT_ID_COLSInterpretationPersistence.FILE_EXPERIMENT_IMAGEInterpretationPersistence.FILE_EXPERIMENT_TSInterpretationPersistence.FILE_H2O_SONAR_HTMLInterpretationPersistence.FILE_INTERPRETATION_HTMLInterpretationPersistence.FILE_INTERPRETATION_HTML_4_PDFInterpretationPersistence.FILE_INTERPRETATION_JSONInterpretationPersistence.FILE_INTERPRETATION_PDFInterpretationPersistence.FILE_MLI_EXPERIMENT_LOGInterpretationPersistence.FILE_PREFIX_DATASETInterpretationPersistence.FILE_PROGRESS_JSONInterpretationPersistence.KEY_E_PARAMSInterpretationPersistence.KEY_RESULTInterpretationPersistence.ad_hoc_job_keyInterpretationPersistence.base_dirInterpretationPersistence.create_dataset_path()InterpretationPersistence.data_dirInterpretationPersistence.get_ad_hoc_mli_dir_name()InterpretationPersistence.get_async_log_file_name()InterpretationPersistence.get_base_dir()InterpretationPersistence.get_base_dir_file()InterpretationPersistence.get_experiment_id_cols_path()InterpretationPersistence.get_html_4_pdf_path()InterpretationPersistence.get_html_path()InterpretationPersistence.get_json_path()InterpretationPersistence.get_mli_dir_name()InterpretationPersistence.get_pdf_path()InterpretationPersistence.is_common_params()InterpretationPersistence.is_safe_name()InterpretationPersistence.list_interpretations()InterpretationPersistence.load_common_params()InterpretationPersistence.load_explainers_params()InterpretationPersistence.load_is_image_experiment()InterpretationPersistence.load_is_timeseries_experiment()InterpretationPersistence.load_message_entity()InterpretationPersistence.make_base_dir()InterpretationPersistence.make_dir_zip_archive()InterpretationPersistence.make_interpretation_sandbox()InterpretationPersistence.make_tmp_dir()InterpretationPersistence.mli_keyInterpretationPersistence.resolve_model_path()InterpretationPersistence.rm_base_dir()InterpretationPersistence.rm_dir()InterpretationPersistence.save_as_html()InterpretationPersistence.save_as_json()InterpretationPersistence.save_as_pdf()InterpretationPersistence.save_common_params()InterpretationPersistence.save_experiment_type_hints()InterpretationPersistence.save_message_entity()InterpretationPersistence.tmp_dirInterpretationPersistence.to_alphanum_name()InterpretationPersistence.to_server_file_path()InterpretationPersistence.to_server_path()InterpretationPersistence.user_dir
JsonPersistableExplanationsNanEncoderPersistencePersistence.PREFIX_INTERNAL_STOREPersistence.check_key()Persistence.copy_file()Persistence.delete()Persistence.delete_dir_contents()Persistence.delete_file()Persistence.delete_temp_dir()Persistence.delete_tree()Persistence.exists()Persistence.flush_dir_for_file()Persistence.getcwl()Persistence.is_binary_file()Persistence.is_dir()Persistence.is_dir_or_file()Persistence.is_file()Persistence.key_folder()Persistence.list_dir()Persistence.list_files_by_wildcard()Persistence.load()Persistence.load_json()Persistence.make_dir()Persistence.make_dir_zip_archive()Persistence.make_key()Persistence.make_temp_dir()Persistence.make_temp_file()Persistence.path_to_internal()Persistence.safe_name()Persistence.save()Persistence.touch()Persistence.typePersistence.update()
PersistenceApiPersistenceDataTypePersistenceTypeRobustEncoder
- h2o_sonar.lib.api.plots module
- h2o_sonar.lib.api.problems module
AVIDProblemCodeAVIDProblemCode.E0100_BIASAVIDProblemCode.E0200_EXPLAINABILITYAVIDProblemCode.E0300_TOXICITYAVIDProblemCode.E0400_MISINFORMATIONAVIDProblemCode.P0100_DATAAVIDProblemCode.P0200_MODELAVIDProblemCode.P0300_PRIVACYAVIDProblemCode.P0400_SAFETYAVIDProblemCode.S0400_MODEL_BYPASSAVIDProblemCode.S0500_EXFILTRATIONAVIDProblemCode.S0600_DATA_POISONING
AVIDProblemCodeTypeProblemAndActionProblemCodeProblemSeverityproblems_for_bool_leaderboard()problems_for_cls_leaderboard()problems_for_heat_leaderboard()
- h2o_sonar.lib.api.results module
- Module contents
- h2o_sonar.lib.container package
- Submodules
- h2o_sonar.lib.container.explainer_container module
AsyncLocalContainerContainerRegistryDependencyTreeNodeExplainerContainerExplainerContainer.TYPE_IDExplainerContainer.delete_interpretation()ExplainerContainer.explainers_registryExplainerContainer.gc()ExplainerContainer.get_explainer()ExplainerContainer.get_explainer_class()ExplainerContainer.get_explainer_job_keys_by_id()ExplainerContainer.get_explainer_job_statuses()ExplainerContainer.get_explainer_local_result()ExplainerContainer.get_explainer_log_path()ExplainerContainer.get_explainer_metadata()ExplainerContainer.get_explainer_result_path()ExplainerContainer.get_explainer_snapshot_path()ExplainerContainer.get_interpretation_params()ExplainerContainer.get_interpretation_status()ExplainerContainer.hot_deploy_explainer()ExplainerContainer.list_explainers()ExplainerContainer.list_interpretations()ExplainerContainer.load_interpretations()ExplainerContainer.loggerExplainerContainer.persistence_typeExplainerContainer.register_configured_explainers()ExplainerContainer.register_explainer()ExplainerContainer.run_interpretation()ExplainerContainer.setup()ExplainerContainer.unregister_explainer()ExplainerContainer.update_explainer_result()
ExplainerExecutorLocalExplainerContainerParallelExplainerExecutorSequentialExplainerExecutorregister_ootb_explainers()
- Module contents
- h2o_sonar.lib.integrations package
- Submodules
- h2o_sonar.lib.integrations.genai module
AmazonBedrockFoundationModelAmazonBedrockFoundationModel.customizations_supportedAmazonBedrockFoundationModel.inference_types_supportedAmazonBedrockFoundationModel.input_modalitiesAmazonBedrockFoundationModel.model_arnAmazonBedrockFoundationModel.model_idAmazonBedrockFoundationModel.model_lifecycle_statusAmazonBedrockFoundationModel.model_nameAmazonBedrockFoundationModel.output_modalitiesAmazonBedrockFoundationModel.provider_nameAmazonBedrockFoundationModel.response_streaming_supported
AmazonBedrockKnowledgeBaseAmazonBedrockRagClientAmazonBedrockRagClient.ES_TEMP_PREFIXAmazonBedrockRagClient.ask_collection()AmazonBedrockRagClient.ask_model()AmazonBedrockRagClient.ask_model_structured()AmazonBedrockRagClient.bedrockAmazonBedrockRagClient.bedrock_agentAmazonBedrockRagClient.bedrock_agent_runtimeAmazonBedrockRagClient.bedrock_runtimeAmazonBedrockRagClient.config_factory()AmazonBedrockRagClient.connectionAmazonBedrockRagClient.create_collection()AmazonBedrockRagClient.get_rag_conf()AmazonBedrockRagClient.iamAmazonBedrockRagClient.is_model_enabled()AmazonBedrockRagClient.list_collections()AmazonBedrockRagClient.list_llm_model_names()AmazonBedrockRagClient.list_llm_models()AmazonBedrockRagClient.opensearchserverlessAmazonBedrockRagClient.purge_collections()AmazonBedrockRagClient.purge_uploaded_docs()AmazonBedrockRagClient.s3AmazonBedrockRagClient.s3_resourceAmazonBedrockRagClient.sts
AnthropicClaudeLlmClientAwsClientAwsResourceH2oGptLlmClientH2oGpteRagClientH2oGpteRagClient.CFG_CHAT_CONVERSATIONH2oGpteRagClient.CFG_EMBEDDING_MODELH2oGpteRagClient.CFG_LLMH2oGpteRagClient.CFG_LLM_ARGSH2oGpteRagClient.CFG_PRE_PROMPT_QUERYH2oGpteRagClient.CFG_PRE_PROMPT_SUMMARYH2oGpteRagClient.CFG_PROMPT_QUERYH2oGpteRagClient.CFG_PROMPT_SUMMARYH2oGpteRagClient.CFG_PROMPT_TEMPLATE_IDH2oGpteRagClient.CFG_RAG_CONFIGH2oGpteRagClient.CFG_SELF_REFLECTION_CONFIGH2oGpteRagClient.CFG_SYSTEM_PROMPTH2oGpteRagClient.CFG_TEMPERATUREH2oGpteRagClient.CFG_TEXT_CONTEXT_LISTH2oGpteRagClient.CFG_TIMEOUTH2oGpteRagClient.CFG_USE_AGENTH2oGpteRagClient.DEFAULT_AGENT_TIMEOUTH2oGpteRagClient.DEFAULT_TIMEOUTH2oGpteRagClient.MODEL_SPEC_AUTOH2oGpteRagClient.MODEL_SPEC_COLH2oGpteRagClient.MODEL_SPEC_COL_OPT_EH2oGpteRagClient.MODEL_SPEC_COL_OPT_NH2oGpteRagClient.TypedLlmConfigDictH2oGpteRagClient.TypedLlmConfigDict.chat_conversationH2oGpteRagClient.TypedLlmConfigDict.llmH2oGpteRagClient.TypedLlmConfigDict.llm_argsH2oGpteRagClient.TypedLlmConfigDict.pre_prompt_summaryH2oGpteRagClient.TypedLlmConfigDict.prompt_queryH2oGpteRagClient.TypedLlmConfigDict.system_promptH2oGpteRagClient.TypedLlmConfigDict.text_context_listH2oGpteRagClient.TypedLlmConfigDict.timeout
H2oGpteRagClient.TypedRagConfigDictH2oGpteRagClient.TypedRagConfigDict.embedding_modelH2oGpteRagClient.TypedRagConfigDict.llmH2oGpteRagClient.TypedRagConfigDict.llm_argsH2oGpteRagClient.TypedRagConfigDict.pre_prompt_queryH2oGpteRagClient.TypedRagConfigDict.pre_prompt_summaryH2oGpteRagClient.TypedRagConfigDict.prompt_queryH2oGpteRagClient.TypedRagConfigDict.prompt_summaryH2oGpteRagClient.TypedRagConfigDict.prompt_template_idH2oGpteRagClient.TypedRagConfigDict.rag_configH2oGpteRagClient.TypedRagConfigDict.self_reflection_configH2oGpteRagClient.TypedRagConfigDict.system_promptH2oGpteRagClient.TypedRagConfigDict.timeout
H2oGpteRagClient.ask_collection()H2oGpteRagClient.ask_model()H2oGpteRagClient.ask_model_structured()H2oGpteRagClient.clientH2oGpteRagClient.config_factory()H2oGpteRagClient.create_collection()H2oGpteRagClient.humanize_err_msg()H2oGpteRagClient.list_collections()H2oGpteRagClient.list_llm_model_names()H2oGpteRagClient.purge_collections()H2oGpteRagClient.purge_uploaded_docs()
H2oLlmOpsClientLlmHostClientMsAzureOpenAiLlmClientOllamaClientOpenAiAssistantsRagClientOpenAiAssistantsRagClientVersion1OpenAiAssistantsRagClientVersion1.BASE_LLM_MODELSOpenAiAssistantsRagClientVersion1.DEFAULT_LLM_MODELOpenAiAssistantsRagClientVersion1.HEADERS_VERSION_1OpenAiAssistantsRagClientVersion1.HEADERS_VERSION_2OpenAiAssistantsRagClientVersion1.KWARGS_ASSISTANTOpenAiAssistantsRagClientVersion1.KWARGS_RUNOpenAiAssistantsRagClientVersion1.KWARGS_THREADOpenAiAssistantsRagClientVersion1.ask_collection()OpenAiAssistantsRagClientVersion1.ask_model()OpenAiAssistantsRagClientVersion1.ask_model_structured()OpenAiAssistantsRagClientVersion1.clientOpenAiAssistantsRagClientVersion1.config_factory()OpenAiAssistantsRagClientVersion1.config_normalize()OpenAiAssistantsRagClientVersion1.config_resolve()OpenAiAssistantsRagClientVersion1.create_collection()OpenAiAssistantsRagClientVersion1.list_collections()OpenAiAssistantsRagClientVersion1.list_llm_model_names()OpenAiAssistantsRagClientVersion1.purge_collections()OpenAiAssistantsRagClientVersion1.purge_uploaded_docs()
OpenAiAssistantsRagClientVersion2OpenAiAssistantsRagClientVersion2.BASE_LLM_MODELSOpenAiAssistantsRagClientVersion2.DEFAULT_LLM_MODELOpenAiAssistantsRagClientVersion2.HEADERS_VERSION_2OpenAiAssistantsRagClientVersion2.ask_collection()OpenAiAssistantsRagClientVersion2.ask_model()OpenAiAssistantsRagClientVersion2.ask_model_structured()OpenAiAssistantsRagClientVersion2.clientOpenAiAssistantsRagClientVersion2.create_collection()OpenAiAssistantsRagClientVersion2.list_collections()OpenAiAssistantsRagClientVersion2.list_llm_model_names()OpenAiAssistantsRagClientVersion2.purge_collections()OpenAiAssistantsRagClientVersion2.purge_uploaded_docs()
OpenAiLlmClientRagChunkRetrievalMethodRagClientTimeoutRetryExpBackoffCtxTypedH2ogptLlmConfigDictTypedOllamaModelFileDictTypedOllamaModelFileDict.mirorstatTypedOllamaModelFileDict.mirorstat_etaTypedOllamaModelFileDict.mirorstat_tauTypedOllamaModelFileDict.num_ctxTypedOllamaModelFileDict.num_predictTypedOllamaModelFileDict.repeat_last_nTypedOllamaModelFileDict.repeat_penaltyTypedOllamaModelFileDict.seedTypedOllamaModelFileDict.stopTypedOllamaModelFileDict.temperatureTypedOllamaModelFileDict.tfs_zTypedOllamaModelFileDict.top_kTypedOllamaModelFileDict.top_p
get_client_for_connection()log_action()
- h2o_sonar.lib.integrations.mv_adapter module
ExplainerToMvTestAdapterMvResultJSonEncoderMvResultPersistenceMvResultPersistence.DIR_MVARTIFACTSMvResultPersistence.DIR_MVLOGMvResultPersistence.DIR_MVRESULTSMvResultPersistence.DIR_MVSETTINGSMvResultPersistence.DIR_MVTESTMvResultPersistence.FILE_INDEXMvResultPersistence.FORMAT_DATETIMEMvResultPersistence.KEY_COLUMNSMvResultPersistence.KEY_COLUMN_SUMMARIESMvResultPersistence.KEY_COL_HISTOGRAM_STATSMvResultPersistence.KEY_DATAMvResultPersistence.KEY_DIRMvResultPersistence.KEY_ERRORMvResultPersistence.KEY_FILENAMEMvResultPersistence.KEY_HASHMvResultPersistence.KEY_LEVELMvResultPersistence.KEY_MSGSMvResultPersistence.KEY_MV_FPATHMvResultPersistence.KEY_MV_IDMvResultPersistence.KEY_MV_NAMEMvResultPersistence.KEY_MV_TYPEMvResultPersistence.KEY_NAMEMvResultPersistence.KEY_N_COLSMvResultPersistence.KEY_N_ROWSMvResultPersistence.KEY_ORIGIN_OBJ_KEYMvResultPersistence.KEY_PATHMvResultPersistence.KEY_PLATFORM_MVIDMvResultPersistence.KEY_PLATFORM_OBJ_KEYMvResultPersistence.KEY_SAMPLE_TABLEMvResultPersistence.KEY_SHAPEMvResultPersistence.KEY_SIZEMvResultPersistence.KEY_SIZE_STRMvResultPersistence.KEY_SUMMARYMvResultPersistence.KEY_TEXTMvResultPersistence.KEY_TSMvResultPersistence.KEY_TYPEMvResultPersistence.TYPE_MV_ARTIFACTSMvResultPersistence.TYPE_MV_ARTIFACT_INFOMvResultPersistence.TYPE_NONE_STRMvResultPersistence.TYPE_SHAPE_STRMvResultPersistence.export_mv_test()MvResultPersistence.import_mv_test()MvResultPersistence.set_target_dir()MvResultPersistence.set_test_dir_name()MvResultPersistence.split_full_type()
- h2o_sonar.lib.integrations.ragas_adapter module
- Module contents
- h2o_sonar.lib.api package
- Module contents
- Subpackages
- h2o_sonar.methods package
- Subpackages
- h2o_sonar.methods.core package
- Submodules
- h2o_sonar.methods.core.method module
FeatureTypesFeatureTypes.DEFAULT_DATE_FEATURE_FORMATFeatureTypes.KEY_CATEGORICAL_FEATURESFeatureTypes.KEY_CATNUM_FEATURESFeatureTypes.KEY_DATE_FEATURESFeatureTypes.KEY_DATE_FEATURES_FORMATFeatureTypes.KEY_DATE_TIME_FEATURESFeatureTypes.KEY_ID_FEATURESFeatureTypes.KEY_IMAGE_FEATURESFeatureTypes.KEY_NUMERIC_FEATURESFeatureTypes.KEY_QUANTILE_BINSFeatureTypes.KEY_TEXT_FEATURESFeatureTypes.KEY_TIME_FEATURES
FeaturesMetadataFeaturesMetadata.add()FeaturesMetadata.categorical_featuresFeaturesMetadata.categorical_numeric_featuresFeaturesMetadata.create_blank_dict()FeaturesMetadata.date_featuresFeaturesMetadata.date_time_featuresFeaturesMetadata.empty()FeaturesMetadata.format_date_featuresFeaturesMetadata.get()FeaturesMetadata.id_featuresFeaturesMetadata.image_featuresFeaturesMetadata.numeric_featuresFeaturesMetadata.qtile_binning_featuresFeaturesMetadata.set()FeaturesMetadata.text_featuresFeaturesMetadata.time_featuresFeaturesMetadata.to_dict()FeaturesMetadata.to_json()
MethodMethod.DEFAULT_GRID_RESOLUTIONMethod.KEY_CAT_WITH_NUM_BINMethod.LABEL_PREFIX_CLASSMethod.LABEL_REGRESSIONMethod.MISSING_VALUESMethod.create_date_aware_bins()Method.diagnosticsMethod.explain()Method.interpretable_modelMethod.is_missing_value()Method.method_nameMethod.method_typeMethod.opt_import_err_msg()
- h2o_sonar.methods.core.stats module
- Module contents
- h2o_sonar.methods.utils package
- h2o_sonar.methods.core package
- Module contents
- Subpackages
- h2o_sonar.utils package
- Submodules
- h2o_sonar.utils.binning module
- h2o_sonar.utils.caching module
cache_all_minilm_l6_v2()cache_all_models()cache_baai_bge_small_en()cache_baai_bge_small_env15()cache_bert_base_uncased()cache_bge_m3()cache_detoxify_models()cache_eval_studio_models()cache_gptscore_evaluator_model()cache_hkunlp_instructor()cache_lmppl_perplexity_evaluator_model()cache_nltk()cache_nltk_averaged_perceptron_tagger()cache_nltk_punkt()cache_nltk_wordnet()cache_summac_vitc()cache_tiktoken_blobs()cache_vectara_hallucination_model()
- h2o_sonar.utils.crypto module
- h2o_sonar.utils.io module
- h2o_sonar.utils.normalization module
- h2o_sonar.utils.preprocessing module
- h2o_sonar.utils.problem_detection module
- h2o_sonar.utils.perturbations module
AbcSynAntPerturbatorAntonymPerturbatorCommaPerturbatorContextualMisinformationPerturbatorCopyPerturbatorEncodingPerturbatorEncodingPerturbatorBase16KeywordTyposCharacterPerturbatorPerturbatorPerturbatorDescriptorPerturbatorRegistryQwertyPerturbatorRandomCharacterDeletePerturbatorRandomCharacterInsertPerturbatorRandomCharacterReplacementPerturbatorRandomOCRCharacterPerturbatorSynonymPerturbatorWordSwapPerturbatorregister_ootb_perturbators()
- h2o_sonar.utils.sampling module
- h2o_sonar.utils.sanitization module
- h2o_sonar.utils.testing module
InMemoryLlmHostPromptCacheInMemoryLlmHostPromptCache.KEY_DATAInMemoryLlmHostPromptCache.add_test_lab()InMemoryLlmHostPromptCache.clear()InMemoryLlmHostPromptCache.evict()InMemoryLlmHostPromptCache.get()InMemoryLlmHostPromptCache.get_llm_model_names()InMemoryLlmHostPromptCache.load_from_json()InMemoryLlmHostPromptCache.load_from_url()InMemoryLlmHostPromptCache.put()InMemoryLlmHostPromptCache.save_to_json()InMemoryLlmHostPromptCache.to_dict()
LlmHostPromptCacheLlmHostPromptCache.KEY_ACTUAL_OUTPUTLlmHostPromptCache.KEY_CONTEXTLlmHostPromptCache.KEY_CORPUSLlmHostPromptCache.KEY_COSTLlmHostPromptCache.KEY_DURATIONLlmHostPromptCache.KEY_EXTRASLlmHostPromptCache.KEY_INPUTLlmHostPromptCache.KEY_LLM_MODEL_NAMELlmHostPromptCache.KEY_MODEL_TYPELlmHostPromptCache.PREFIX_KEYLlmHostPromptCache.clear()LlmHostPromptCache.evict()LlmHostPromptCache.get()LlmHostPromptCache.get_key()LlmHostPromptCache.get_llm_model_names()LlmHostPromptCache.put()LlmHostPromptCache.str_key_to_dict()
RagTestCaseConfigRagTestCaseConfig.KEY_CATEGORIESRagTestCaseConfig.KEY_CONDITIONRagTestCaseConfig.KEY_CONSTRAINTSRagTestCaseConfig.KEY_EXPECTED_OUTPUTRagTestCaseConfig.KEY_KEYRagTestCaseConfig.KEY_PROMPTRagTestCaseConfig.KEY_RELSRagTestCaseConfig.add_relationship()RagTestCaseConfig.copy()RagTestCaseConfig.perturb()RagTestCaseConfig.to_dict()
RagTestConfigRagTestLabRagTestLab.bind()RagTestLab.build()RagTestLab.complete_dataset()RagTestLab.complete_from_shards()RagTestLab.doc_cacheRagTestLab.from_eval_results()RagTestLab.from_llm_test_suite()RagTestLab.from_rag_test_suite()RagTestLab.get_evaluated_model_for_key()RagTestLab.insight_internal_llm_errors()RagTestLab.integrity_check()RagTestLab.load_from_json()RagTestLab.merge()RagTestLab.purge()RagTestLab.split_to_shards()RagTestLab.split_to_shards_by_model()RagTestLab.stat_llm_model_errorsRagTestLab.stat_llm_model_request_durationRagTestLab.stat_llm_model_retriesRagTestLab.stat_llm_model_success_countRagTestLab.stat_llm_model_timeoutsRagTestLab.stats()RagTestLab.sync_documents()RagTestLab.to_dict()RagTestLab.trim()
RagTestLabPromptCacheRagTestLabPromptCache.ENV_VAR_H2O_SONAR_PROMPT_CACHERagTestLabPromptCache.ENV_VAR_H2O_SONAR_PROMPT_CACHE_SIZERagTestLabPromptCache.ENV_VAR_H2O_SONAR_PROMPT_CACHE_SRCRagTestLabPromptCache.ENV_VAR_H2O_SONAR_PROMPT_CACHE_STATICRagTestLabPromptCache.MAX_ITEMSRagTestLabPromptCache.cache()RagTestLabPromptCache.reinitialize()
RagTestSuiteConfigRagTestSuiteConfig.KEY_CATSRagTestSuiteConfig.KEY_DESCRIPTIONRagTestSuiteConfig.KEY_NAMERagTestSuiteConfig.KEY_TESTSRagTestSuiteConfig.KEY_TEST_CASESRagTestSuiteConfig.add_test_case()RagTestSuiteConfig.copy()RagTestSuiteConfig.from_llm_dataset()RagTestSuiteConfig.load_from_json()RagTestSuiteConfig.perturb()RagTestSuiteConfig.save_as_json()RagTestSuiteConfig.split()RagTestSuiteConfig.testsRagTestSuiteConfig.to_dict()RagTestSuiteConfig.trim_tests()
TestLabTestLabPersistenceTestLabPersistence.DIR_CHAT_MSGTestLabPersistence.DIR_CHAT_SESSIONTestLabPersistence.DIR_COMPLETION_OFTestLabPersistence.DIR_TEST_LABTestLabPersistence.get_chat_message_path()TestLabPersistence.get_chat_session_dir()TestLabPersistence.get_test_case_completion_dir()TestLabPersistence.get_test_lab_dir()
- Module contents
- Submodules
Submodules
h2o_sonar.config module
- class h2o_sonar.config.ConfigItemType(value)
Bases:
EnumConfiguration item types.
- CONNECTION = 1
- LICENSE = 2
- class h2o_sonar.config.ConfigKeys
Bases:
object- KEY_DESCRIPTION = 'description'
- KEY_ENCRYPTED = 'encrypted'
- KEY_NAME = 'name'
- class h2o_sonar.config.ConnectionConfig(connection_type: str, name: str, description: str, server_url: str | None = '', server_id: str | None = '', auth_server_url: str | None = '', environment_url: str | None = '', client_id: str | None = '', realm_name: str | None = '', token: str | None = '', token_use_type: str | None = '', username: str | None = '', password: str | None = '', extra_params: dict | None = None, key: str | None = '')
Bases:
ConfigKeysA generic purpose connection configuration which can be used to connect to various H2O.ai and 3rd party products and services.
Overview of the fields which are important for the H2O.ai authentication methods:
Username/password authentication method requires (Keycloak): - authentication server URL: auth_server_url - client ID: client_id - client secret: token + token_use_type==SECRET - username and password (on getting the access token)
Refresh token authentication method requires (Keycloak): - authentication server URL: auth_server_url - client ID: client_id - refresh token: token + token_use_type==REFRESH_TOKEN - realm: realm_name
H2O token provider authentication method requires: - environment URL: environment_url - refresh token: token + token_use_type==REFRESH_TOKEN
- ENCRYPTED_FIELDS = ['token', 'password']
- KEY_AUTH_SERVER_URL = 'auth_server_url'
- KEY_CLIENT_ID = 'client_id'
- KEY_ENV_URL = 'environment_url'
- KEY_EXTRA_PARAMS = 'extra_params'
- KEY_KEY = 'key'
- KEY_PASSWORD = 'password'
- KEY_REALM_NAME = 'realm_name'
- KEY_SERVER_ID = 'server_id'
- KEY_SERVER_URL = 'server_url'
- KEY_TOKEN = 'token'
- KEY_TOKEN_USE_TYPE = 'token_use_type'
- KEY_TYPE = 'connection_type'
- KEY_USERNAME = 'username'
- static from_dict(config_dict: dict, decrypt: bool = True, encryption_key: str = '') ConnectionConfig
Create the connection configuration from dictionary.
JSon example w/ unencrypted fields:
{ "key": "096ca3c2-4715-11ee-9e2f-10828613f8ad", "connection_type": "ML_API", "name": "My connection name", "description": "My connection description.", "server_url": "http://localhost:8080", "server_id": "my-model-validation-dai", "auth_server_url": "http://localhost:8080/auth", "environment_url": "https://cloud.h2o.ai/", "realm_name": "my_realm", "client_id": "my_client_id", "token": "", "token_use_type": "", "username": "sonaruser", "password": "s3cr3tpa33word" }
JSon example w/ encrypted fields:
{ "key": "096ca3c2-4715-11ee-9e2f-10828613f8ad", "connection_type": "ML_API", "name": "My connection name", "description": "My connection description.", "server_url": "http://localhost:8080", "server_id": "my-model-validation-dai", "auth_server_url": "http://localhost:8080/auth", "environment_url": "https://cloud.h2o.ai/", "realm_name": "my_realm", "client_id": "my_client_id", "token": { "encrypted": "gAAAAABkTfy18iis3ya8nitGi...URMxE14aJJk=" }, "token_use_type": "REFRESH_TOKEN", "username": "sonaruser", "password": { "encrypted": "py18iis3ya8nitG=" } }
- class h2o_sonar.config.ConnectionConfigType(value)
Bases:
EnumPredefined connection types.
- AMAZON_BEDROCK = 14
- ANTHROPIC_CHAT = 12
- AZURE_OPENAI_CHAT = 11
- DRIVERLESS_AI = 1
- DRIVERLESS_AI_AIEM = 3
- DRIVERLESS_AI_STEAM = 2
- H2O_3 = 4
- H2O_GPT = 5
- H2O_GPT_E = 6
- H2O_LLM_OPS = 7
- HF_SPACES = 13
- OLLAMA = 8
- OPENAI_CHAT = 10
- OPENAI_RAG = 9
- class h2o_sonar.config.EvaluationJudgeConfig(name: str, description: str, judge_type: str, connection: ConnectionConfig, llm_model_name: str = '', collection_id: str = '', key: str = '')
Bases:
objectEvaluation judge configuration.
- KEY_COLLECTION_ID = 'collection_id'
- KEY_CONNECTION = 'connection'
- KEY_DESCRIPTION = 'description'
- KEY_JUDGE_TYPE = 'judge_type'
- KEY_KEY = 'key'
- KEY_LLM_MODEL_NAME = 'llm_model_name'
- KEY_NAME = 'name'
- static from_dict(config_dict: dict) EvaluationJudgeConfig
- class h2o_sonar.config.EvaluationJudgeType(value)
Bases:
Enum- anthropic_llm = 8
- azure_openai_llm = 7
- custom = 10
- h2ogpt = 1
- h2ogpte = 2
- h2ogpte_llm = 3
- h2ollmops = 4
- ollama = 9
- openai_llm = 6
- openai_rag = 5
- class h2o_sonar.config.H2o3Config
Bases:
objectH2O-3 configuration keys used by H2O Sonar.
- DEFAULT_AUTO_CLEANUP = True
- DEFAULT_AUTO_START = True
- DEFAULT_AUTO_STOP = False
- DEFAULT_HOST = 'localhost'
- DEFAULT_MAX_MEM_SIZE = '4G'
- DEFAULT_MIN_MEM_SIZE = '2G'
- DEFAULT_PORT = 12349
- KEYS = ['h2o_min_mem_size', 'h2o_max_mem_size', 'h2o_host', 'h2o_port', 'h2o_auto_start', 'h2o_auto_cleanup', 'h2o_auto_stop']
- KEY_AUTO_CLEANUP = 'h2o_auto_cleanup'
- KEY_AUTO_START = 'h2o_auto_start'
- KEY_AUTO_STOP = 'h2o_auto_stop'
- KEY_HOST = 'h2o_host'
- KEY_MAX_MEM_SIZE = 'h2o_max_mem_size'
- KEY_MIN_MEM_SIZE = 'h2o_min_mem_size'
- KEY_PORT = 'h2o_port'
- class h2o_sonar.config.H2oSonarConfig(connections: list[ConnectionConfig] | None = None, licenses: list[LicenseConfig] | None = None, evaluation_judges: list[EvaluationJudgeConfig] | None = None, ignore_env: bool | None = False)
Bases:
objectH2O Sonar configuration with global configuration items which impact H2O Sonar behavior, methods and explainers.
Configuration priority from lowest to highest:
default value
configuration file
environment variable
command line argument
configuration item
- CFG_BRANDING = <h2o_sonar.lib.api.commons.Param object>
- CFG_CREATE_HTML_REPRESENTATIONS = <h2o_sonar.lib.api.commons.Param object>
- CFG_CUSTOM_EXPLAINERS = <h2o_sonar.lib.api.commons.Param object>
- CFG_DEVICE = <h2o_sonar.lib.api.commons.Param object>
- CFG_DO_SAMPLE = <h2o_sonar.lib.api.commons.Param object>
- CFG_ENABLE_DATASET_DOWNLOADING = <h2o_sonar.lib.api.commons.Param object>
- CFG_ENABLE_SLOW_PERTURBATORS = <h2o_sonar.lib.api.commons.Param object>
- CFG_FORCE_EVAL_JUDGE = <h2o_sonar.lib.api.commons.Param object>
- CFG_H2O_AUTO_CLEANUP = <h2o_sonar.lib.api.commons.Param object>
- CFG_H2O_AUTO_START = <h2o_sonar.lib.api.commons.Param object>
- CFG_H2O_AUTO_STOP = <h2o_sonar.lib.api.commons.Param object>
- CFG_H2O_HOST = <h2o_sonar.lib.api.commons.Param object>
- CFG_H2O_MAX_MEM_SIZE = <h2o_sonar.lib.api.commons.Param object>
- CFG_H2O_MIN_MEM_SIZE = <h2o_sonar.lib.api.commons.Param object>
- CFG_H2O_PORT = <h2o_sonar.lib.api.commons.Param object>
- CFG_HTTP_SSL_CERT_VERIFY = <h2o_sonar.lib.api.commons.Param object>
- CFG_LOOK_AND_FEEL = <h2o_sonar.lib.api.commons.Param object>
- CFG_MODEL_CACHE_DIR = <h2o_sonar.lib.api.commons.Param object>
- CFG_MP_START_METHOD = <h2o_sonar.lib.api.commons.Param object>
- CFG_NUM_QUANTILES = <h2o_sonar.lib.api.commons.Param object>
- CFG_PER_EXPLAINER_LOGGER = <h2o_sonar.lib.api.commons.Param object>
- CFG_SAMPLE_SIZE = <h2o_sonar.lib.api.commons.Param object>
- ENV_VAR_CFG_PREFIX = 'H2O_SONAR_CFG_'
- KEY_BRANDING = 'branding'
- KEY_CONNECTIONS = 'connections'
- KEY_CREATE_HTML_REPRESENTATIONS = 'create_html_representations'
- KEY_CUSTOM_EXPLAINERS = 'custom_explainers'
- KEY_DEVICE = 'device'
- KEY_ENABLE_SLOW_PERTURBATORS = 'enable_slow_perturbators'
- KEY_EVALUATION_JUDGES = 'evaluation_judges'
- KEY_FORCE_EVAL_JUDGE = 'force_eval_judge'
- KEY_HTTP_SSL_CERT_VERIFY = 'http_ssl_cert_verify'
- KEY_LICENSES = 'licenses'
- KEY_LOOK_AND_FEEL = 'look_and_feel'
- KEY_MODEL_CACHE_DIR = 'model_cache_dir'
- KEY_PER_EXPLAINER_LOGGER = 'per_explainer_logger'
- MP_START_METHOD_FORK = 'fork'
- MP_START_METHOD_FORKSERVER = 'forkserver'
- MP_START_METHOD_SPAWN = 'spawn'
- VALUE_AUTO = ''
- VALUE_CPU = 'cpu'
- VALUE_CUDA = 'cuda'
- VALUE_GPU = 'gpu'
- VALUE_MPS = 'mps'
- VALUE_NPU = 'npu'
- VALUE_STR_FALSE = 'false'
- VALUE_STR_TRUE = 'true'
- add_connection(connection_config: ConnectionConfig)
- add_evaluation_judge(evaluation_judge_config: EvaluationJudgeConfig)
- add_license(license_config: LicenseConfig)
- copy()
- env_and_override()
Get configuration from environment variables following the naming convention and override this instance configuration.
- from_toml()
- get_connection(connection_key: str, connection_type: str = '') ConnectionConfig | None
- get_evaluation_judge(judge_key: str = '') EvaluationJudgeConfig | None
- get_license(license_key: str) LicenseConfig | None
- property http_ssl_cert_verify
- static load(config_path: str, encryption_key: str = '') dict | None
Load JSon/TOML file with configuration items specified in the configuration file.
- Parameters:
- config_pathstr
Path to the configuration file.
- encryption_keystr
Optional encryption key to decrypt/encrypt sensitive data. If not specified, then shell environment variable
H2O_SONAR_ENCRYPTION_KEYwill be used.
- Returns:
- dict
Dictionary with the configuration if file can be found and parsed,
Noneotherwise.
- load_and_override(config_path: str, encryption_key: str = '')
Load JSon/TOML file and override this instance configuration items with configuration items specified in the configuration file.
- Parameters:
- config_pathstr
Path to the configuration file.
- encryption_keystr
Optional encryption key to decrypt encrypted fields in the configuration file. If not specified, then shell environment variable
H2O_SONAR_ENCRYPTION_KEYwill be used.
- resolve_gpu_cpu_device(result_format: str = 'torch')
Resolve a GPU/CPU device for the evaluation.
- Parameters:
- result_formatstr
Result format - one of “str” or “torch”.
- Returns:
- str | torch.device | None
Device string, torch device object, or None if unable to resolve.
- save(config_path: str, config_data: dict | None = None, encrypt: bool = True, encryption_key: str = '')
Save configuration to JSon file.
- Parameters:
- config_pathstr
Path to the configuration file.
- config_datadict
Optional dictionary with configuration data
- encryptbool
Whether to encrypt sensitive data.
- encryption_keystr
Optional encryption key to encrypt sensitive data. If not specified, then shell environment variable
H2O_SONAR_ENCRYPTION_KEYwill be used.
- to_toml()
- class h2o_sonar.config.LicenseConfig(product: str, name: str, description: str, license: str = '', license_file: str = '', key: str = '')
Bases:
ConfigKeysA product license configuration.
- ENCRYPTED_FIELDS = ['license']
- KEY_KEY = 'key'
- KEY_LICENSE = 'license'
- KEY_LICENSE_FILE = 'license_file'
- KEY_PRODUCT = 'product'
- static from_dict(config_dict: dict, decrypt: bool = True, encryption_key: str = '') LicenseConfig
h2o_sonar.errors module
- exception h2o_sonar.errors.DatasetTooBigError(message, suggestion=None)
Bases:
MliErrorThe dataset is too big to be processed by H2O Sonar.
- exception h2o_sonar.errors.ExplainerCompatibilityError(message, suggestion=None)
Bases:
MliErrorExplainer not compatible error.
- exception h2o_sonar.errors.InvalidArgumentError(message, suggestion=None)
Bases:
MliErrorInvalid (CLI) argument error.
- exception h2o_sonar.errors.InvalidArgumentValueError(message, suggestion=None)
Bases:
MliErrorInvalid (CLI) argument value error.
- exception h2o_sonar.errors.InvalidDataError(message, suggestion=None)
Bases:
MliErrorInvalid data error.
- exception h2o_sonar.errors.MliError(message, suggestion=None)
Bases:
ExceptionMLI error.
- exception h2o_sonar.errors.MliJsonDeserializationError(message, suggestion=None)
Bases:
MliErrorMLI JSon deserialization error.
- exception h2o_sonar.errors.MliJsonSerializationError(message, suggestion=None)
Bases:
MliErrorMLI JSon serialization error.
- exception h2o_sonar.errors.MliNotFoundError(message, suggestion=None)
Bases:
MliErrorEntity not found error.
- exception h2o_sonar.errors.MliPredictMethodError(message, suggestion=None)
Bases:
MliErrorPredict method failure.
- exception h2o_sonar.errors.MliTypeError(message, suggestion=None)
Bases:
MliErrorWrong type error.
- exception h2o_sonar.errors.MliUnsupportedDataFormatError(message, suggestion=None)
Bases:
MliUnsupportedErrorUnsupported data type error.
- exception h2o_sonar.errors.MliUnsupportedOperationError(message, suggestion=None)
Bases:
MliUnsupportedErrorUnsupported operation.
h2o_sonar.h2o_sonar_cli module
h2o_sonar.interpret module
- h2o_sonar.interpret.add_config_item(config_type: str, config_value: dict | str, h2o_sonar_config_path: Path | str | None = None, encryption_key: str = '')
Add configuration item.
- Parameters:
- config_typestr
Configuration item type - see config.ConfigItemType for options.
- config_valuedict | str
Configuration item value represented either as dictionary or as string with JSon serialization of the configuration item. It is expected that the config item is NOT encrypted.
- h2o_sonar_config_pathpathlib.Path | str | None
Path to the H2O Sonar configuration file. If
None, then in-memory (current) configuration singleton is modified.- encryption_keystr
Encryption key to be used for encrypting sensitive data written in the configuration. If
None, shell environment variableH2O_SONAR_ENCRYPTION_KEYwith the encryption key must be set.
- h2o_sonar.interpret.describe_explainer(explainer: type[Explainer] | str, portable: bool = False) dict
Get explainer description.
- Parameters:
- explainerType[e8s.Explainer] | str
Explainer to describe.
- portablebool
If
True, then floats (infinity, NaN) and tuples are converted to be portable - from strings to max/min values of respective types.
- Returns:
- dict
Dictionary with explainer name and parameters.
- h2o_sonar.interpret.do_gc()
Free system resources:
shutdowns process pool(s)
runs garbage collector
clears temporary files
- h2o_sonar.interpret.get_config(h2o_sonar_config_path: Path | str | None = None, encryption_key: str = '') dict
Get configuration item.
- Parameters:
- h2o_sonar_config_pathpathlib.Path | str | None
Path to the H2O Sonar configuration file. If
None, then in-memory ( current) configuration singleton will be returned.- encryption_keystr | None
Encryption key to be used for decryption of the sensitive data in the configuration. If not set, then the encryption key from shell environment variable
H2O_SONAR_ENCRYPTION_KEYwill be used. If encryption key is not provided, then sensitive data will be returned encrypted.
- h2o_sonar.interpret.list_explainers(experiment_types: list[str] | None = None, explanation_scopes: list[str] | None = None, model_meta: ExplainableModelMeta | None = None, keywords: list[str] | None = None, explainer_filter: list[FilterEntry] | None = None, container: str | ExplainerContainer | None = None, args_as_json_location: Path | str | None = None, portable: bool = False, extra_params: dict | None = None) list[ExplainerDescriptor]
List explainers by supported experiment types, scores, keywords and other criteria. Parameters are used with
ANDlogical operator.- Parameters:
- experiment_typeslist[str] | None
Filter explainers by supported experiment types - regression, binomial or multinomial.
- explanation_scopeslist[str] | None
Filter explainers by supported explanation scopes - local or global.
- model_metamodels.ExplainableModelMeta | None
Filter explainers by model metadata.
- keywordslist[str] | None
Filter explainers by keywords.
- explainer_filterlist[commons.FilterEntry] | None
Filter explainers by generic filter (forward compatible filtering). See
FilterEntryfor supported search types.- containerstr | explainer_container.ExplainerContainer | None
Optional explainer container name or instance to be used to run the interpretation.
- args_as_json_locationpathlib.Path | str | None
Load all positional arguments and keyword arguments from JSon file. This is useful when input is generated, persisted, repeated and used from CLI (which doesn’t support all the options). IMPORTANT: if this argument is specified, then all other function parameters are ignored.
- portablebool
If
True, then floats (infinity, NaN) and tuples are converted to be portable - from strings to max/min values of respective types.- extra_paramsdict | None
Extra parameters.
- Returns:
- list[explainers.ExplainerDescriptor]
Explainers compliant with provided filters.
- h2o_sonar.interpret.list_interpretations(results_location: str | Path | dict, persistence_type: PersistenceType = PersistenceType.file_system, container: str | ExplainerContainer | None = None, log_level: int = 30, extra_params: dict | None = None) list[str]
List interpretations in given results location.
- Parameters:
- results_locationstr | pathlib.Path | dict
Location used e.g. by
run_interpretation()to store interpretations results - filesystem (path as string orPath), memory (dictionary) or DB. IfNone, then results are loaded from the current directory.- persistence_typepersist.PersistenceType
Optional choice of the persistence type: file-system (default), in-memory or database. This option does not override persistence type in case that container is provided.
- containerstr | explainer_container.ExplainerContainer | None
Optional explainer container name (str) or container instance to be used to run the interpretation.
- log_levelint
Optional container and explainers log level.
- extra_paramsdict | None
Extra parameters.
- Returns:
- list[str]
Interpretation keys in given results location.
- h2o_sonar.interpret.register_explainer(explainer_class: type[Explainer], explainer_id: str = '', container: str | ExplainerContainer | None = None, extra_params: dict | None = None) str
Register explainer.
- Parameters:
- explainer_classType[explainers.Explainer]
Explainer class.
- explainer_idstr
Optional custom explainer ID to be used for explainer identification.
- containerstr | explainer_container.ExplainerContainer | None
Optional explainer container name or instance to be used to run the interpretation.
- extra_paramsdict | None
Extra parameters.
- Returns:
- str
Explainer ID.
- h2o_sonar.interpret.resolve_container(container: str | ExplainerContainer | None = None, results_location: str | Any = '', persistence_api: PersistenceApi | None = None, persistence_type: PersistenceType | None = PersistenceType.file_system, do_setup: bool = True, logger: SonarLogger | None = None, log_level: int | None = None) ExplainerContainer
Get explainer container instance to configure, register explainers and tune it.
- Parameters:
- containerstr | explainer_container.ExplainerContainer | None
Optional explainer container name (str) or container instance to be used to run the interpretation.
- results_locationpathlib.Path | str | dict | Any | None
Where to store interpretation results - filesystem (path as string or
Path), memory (dictionary) or DB. IfNone, then results are stored to the current directory.- persistence_apipersist.PersistenceApi | None
Instance of the persistence API allowing to create various persistence types (like file-system or DB)
- persistence_typepersist.PersistenceType | None
Optional choice of the persistence type: file-system (default), in-memory or database. This option does not override persistence type in case that container is provided.
- do_setupbool
Ensure explainer container set up.
- loggerloggers.SonarLogger | None
Optional custom logger.
- log_levelint
Optional container and explainers log level.
- Returns:
- explainer_container.ExplainerContainer
Explainer container instance.
- h2o_sonar.interpret.run_interpretation(dataset: str | Path | ExplainableDataset | ResourceHandle | Frame | DataFrame | ExplainableDatasetHandle, model: str | Path | ExplainableModel | ResourceHandle | ExplainableModelHandle | Any | None = None, models: list[str | Path | ExplainableModel | ResourceHandle | ExplainableModelHandle | Any] | None = None, target_col: str = '', explainers: list[str | ExplainerToRun] | None = None, explainer_keywords: list[str] | None = None, validset: str | Path | ExplainableDataset | ResourceHandle | Frame | DataFrame | ExplainableDatasetHandle | None = None, testset: str | Path | ExplainableDataset | ResourceHandle | Frame | DataFrame | ExplainableDatasetHandle | None = None, use_raw_features: bool = True, used_features: list | None = None, weight_col: str = '', prediction_col: str = '', drop_cols: list | None = None, sample_num_rows: int | None = 0, sampler: DatasetSampler | None = None, container: str | ExplainerContainer | None = None, results_location: Path | str | dict | Any | None = None, results_formats: list[str] | None = None, persistence_type: PersistenceType = PersistenceType.file_system, run_asynchronously: bool = False, run_explainers_in_parallel: bool = False, progress_callback: AbstractProgressCallbackContext | None = None, logger: SonarLogger | None = None, log_level: int = 30, args_as_json_location: Path | str | None = None, upload_to: str | ConnectionConfig | None = None, key: str = '', extra_params: dict | None = None) Interpretation
Run interpretation.
- Parameters:
- dataset
Dataset source: explainable dataset instance, datatable frame, string (expect path to CSV, .jay or any other file type supported by datatable), dictionary (used to construct frame).
- model
Path to model (str, Path), explainable model (
ExplainableModel) or an instance of 3rd party model (like Scikit) to interpret.- models
Paths to models (str, Path), explainable models (
ExplainableModel) or an instances of 3rd party models (like Scikit) to interpret.- target_colstr
Target column name - must be valid dataset column name.
- explainerslist[str | commons.ExplainerToRun] | None
Explainer IDs to run within the interpretation or
ExplainerToRuninstances with explainer parameters. In case ofNoneor empty list are run all default compatible explainers.- explainer_keywords: list[str] | None
Run compatible explainers which have given keyword (AND). This setting is used only in case that
explainersparameter is empty list (orNone).- validset
Optional path to validation dataset (str, Path) or datatable Frame instance.
- testset
Optional path to test dataset (str, Path) or datatable Frame instance.
- use_raw_featuresbool
Trueto use original features (default),Falseto force the use of transformed features in surrogate models.- used_featureslist | None
Optional parameter specifying features (dataset columns) used by the model. This parameter is used in case that an instance of the model (not
ExplainableModel) is provided by the user - thereforeExplainableModel’s metadata are not available.- weight_colstr
Name of the weight column to be used by explainers.
- prediction_colstr
Name of the predictions column - in case of 3rd party model (standalone MLI).
- drop_colslist | None
List of the columns to drop from the interpretation i.e. columns names which should not be explained.
- sample_num_rowsint | None
If
None, then automatically sample based on the dataset and RAM size. If > 0, then do sample thedatasettosample_num_rowsnumber of rows. If == 0, then do NOT sample.- samplerDatasetSampler | None
Sampling method (implementation) to be used - see
h2o_sonar.utils.samplingmodule (documentation) for available sampling methods. Use a sampler instance to use the specific sampling method.- containerstr | explainer_container.ExplainerContainer | None
Optional explainer container name (str) or container instance to be used to run the interpretation.
- results_locationpathlib.Path | str | dict | Any | None
Where to store interpretation results - filesystem (path as string or
Path), memory (dictionary) or DB. IfNone, then results are stored to the current directory.- results_formatslist[str] | None
Optional list of the result formats (MIME types) to be generated. If
None, then report in HTML and JSon is created. Supported formats:MIME_PDF,MIME_HTMLandMIME_JSON.- persistence_typepersist.PersistenceType
Optional choice of the persistence type: file-system (default), in-memory or database. This option does not override persistence type in case that container is provided.
- run_asynchronouslybool
Trueto run the interpretation asynchronously - the interpretation is run synchronously by default (False).- run_explainers_in_parallelbool
Trueto run explainers in parallel - explainers are run sequentially by default.- progress_callbackprogress.AbstractProgressCallbackContext | None
Optional progress callback context which is stacked atop default logging callback in
h2o_sonar.lib.api.interpretations::Interpretationconstructor.- loggerloggers.SonarLogger | None
Optional custom logger which implements
loggers.SonarLoggerinterface. Ifloggeris provided, thenlog_levelis ignored.- log_levelint
Optional container and explainers log level. If
loggeris provided, thenlog_levelis ignored.- args_as_json_locationpathlib.Path | str | None
Load all positional arguments and keyword arguments from JSon file. This is useful when input is generated, persisted, repeated and used from CLI (which doesn’t support all the options). IMPORTANT: if this argument is specified, then all other function parameters are ignored.
- upload_tostr | config.ConnectionConfig | None
Upload the interpretation report to the H2O GPT Enterprise in order to talk to the report.
- keystr
Custom interpretation key which must be valid UUID4 string.
- extra_paramsdict | None
Extra parameters.
- Returns:
- interpretations.Interpretation
Interpretations instance with the explainer results (references).
- h2o_sonar.interpret.unregister_explainer(explainer_id: str, container: str | ExplainerContainer | None = None, extra_params: dict | None = None) str
Unregister explainer.
- Parameters:
- explainer_idstr
Custom explainer to be unregistered.
- containerstr | explainer_container.ExplainerContainer | None
Optional explainer container name or instance to be used to run the interpretation.
- extra_paramsdict | None
Extra parameters.
- Returns:
- str
ID of the unregistered explainer or
""no explainer was unregistered.
- h2o_sonar.interpret.upload_interpretation(interpretation_result: Interpretation | InterpretationResult | str | Path, connection: str | ConnectionConfig | None, collection_name: str = '', extra_params: dict | None = None) tuple[str, str]
Upload interpretation to an LLM like h2oGPTE in order to talk to the interpretation report.
- Returns:
- Tuple[str, str]
h2oGPT Enterprise collection ID and URL.
h2o_sonar.loggers module
- class h2o_sonar.loggers.SonarFileLogger(logger_name: str, log_file: str, log_level=30)
Bases:
SonarLoggerFile logger saves log messages to log files.
- FORMATTER = <logging.Formatter object>
- data(data, *args, **kwargs)
- debug(msg, *args, **kwargs)
- error(msg, *args, **kwargs)
- info(msg, *args, **kwargs)
- warning(msg, *args, **kwargs)
- class h2o_sonar.loggers.SonarLogger
Bases:
ABCAbstract logger base class to be extended by runtime specific logging implementations.
- FILE_NAME_H2O_SONAR_LOG = 'h2o-sonar.log'
- data(data, *args, **kwargs)
- debug(msg, *args, **kwargs)
- error(msg, *args, **kwargs)
- info(msg, *args, **kwargs)
- warning(msg, *args, **kwargs)
- class h2o_sonar.loggers.SonarPrintLogger
Bases:
SonarLoggerPrint logger prints log messages using print() method.
- data(data, *args, **kwargs)
- debug(msg, *args, **kwargs)
- error(msg, *args, **kwargs)
- info(msg, *args, **kwargs)
- warning(msg, *args, **kwargs)
- h2o_sonar.loggers.debug(msg, *args, **kwargs)
- h2o_sonar.loggers.error(msg, *args, **kwargs)
- h2o_sonar.loggers.fatal(msg, *args, **kwargs)
- h2o_sonar.loggers.get_level()
- h2o_sonar.loggers.info(msg, *args, **kwargs)
- h2o_sonar.loggers.log(level, msg, *args, **kwargs)
- h2o_sonar.loggers.setLevel(level=0)
- h2o_sonar.loggers.warn(msg, *args, **kwargs)
- h2o_sonar.loggers.warning(msg, *args, **kwargs)