Enterprise h2oGPT Talk to Report Example
H2O Eval Studio can upload the interpretation results to the Enterprise h2oGPT in order to talk to the interpretation report and get answers to questions / use prompts like:
Did the interpretation find any model problems?
Were there any HIGH/MEDIUM/LOW severity problems?
Create an action plan as a bullet list to solve problem.
Is the model fair?
Which features lead to the highest model error?
Which explainers were run by the interpretation?
Summarize the interpretation report.
Similarly for model understanding:
What is the target column of the model?
Which original features are used by the model?
What is the most important transformed feature of the model?
What are the 3 most important original features of the model?
What were the columns of the training dataset?
The typical set of questions is typically centered around the model problem(s) and their solutions.
How can you talk to the report?
Run the interpretation.
Upload the interpretation results to the Enterprise h2oGPT - either directly as the last step of the interpretation run or using the API call or CLI command.
Open the Enterprise h2oGPT to chat with the interpretation report.
[8]:
import os
import logging
import datatable
import daimojo
import webbrowser
from h2o_sonar import config as h2o_sonar_config
from h2o_sonar import interpret
from h2o_sonar.lib.api import commons
from h2o_sonar.lib.api import explainers
from h2o_sonar.lib.api.models import ModelApi
Configuration
First, configure the Enterprise h2oGPT connection. The API key can generated in Enterprise h2oGPT web - use Settings > API Keys > New API Key.
[9]:
H2OGPTE_API_KEY = "" # paste your API key here
H2OGPTE_API_KEY = os.getenv("H2O_GPT_E_API_KEY")
if not H2OGPTE_API_KEY:
raise ValueError("Please set your API key")
H2OGPTE_PLAYGROUND = h2o_sonar_config.ConnectionConfig(
connection_type=h2o_sonar_config.ConnectionConfigType.H2O_GPT_E.name,
name="H2O GPT Enterprise",
description="H2O GPT Enterprise.",
server_url="https://playground.h2ogpte.h2o.ai",
token=,
token_use_type=h2o_sonar_config.TokenUseType.API_KEY.name,
)
h2o_sonar_config.config.add_connection(H2OGPTE_PLAYGROUND)
Interpretation
Run an interpretation with default explainers and upload the interpretation report to Enterprise h2oGPT.
[10]:
# dataset
dataset_path = "../../data/creditcard.csv"
target_col = "default payment next month"
# model
mojo_path = "../../data/models/creditcard-binomial.mojo"
mojo_model = daimojo.model(mojo_path)
model = ModelApi().create_model(
model_src=mojo_model,
target_col=target_col,
used_features=list(mojo_model.feature_names),
)
[11]:
interpretation = interpret.run_interpretation(
dataset=dataset_path,
model=model,
target_col=target_col,
results_location="./results",
log_level=logging.INFO,
upload_to=h2o_sonar_config.config.get_connection(
connection_key=H2OGPTE_PLAYGROUND.key
),
)
Preparing and checking DIA features (None): dataset= | LIMIT_BAL BILL_AMT3 ID PAY_4 PAY_0 BILL_AMT1 PAY_AMT1 PAY_AMT5 PAY_3 PAY_6 … BILL_AMT6 AGE PAY_AMT3 MARRIAGE SEX
| int32 int32 int32 int32 int32 int32 int32 int32 int32 int32 int32 int32 int32 int32 int32
---- + --------- --------- ----- ----- ----- --------- -------- -------- ----- ----- --------- ----- -------- -------- -----
0 | 20000 689 1 -1 -2 3913 0 0 -1 -2 … 0 24 0 1 2
1 | 120000 2682 2 0 -1 2682 0 0 0 2 … 3261 26 1000 2 2
2 | 90000 13559 3 0 0 29239 1518 1000 0 0 … 15549 34 1000 2 2
3 | 50000 49291 4 0 1 46990 2000 1069 0 0 … 29547 37 1200 1 2
4 | 50000 35835 5 0 2 8617 2000 689 -1 0 … 19131 57 10000 1 1
5 | 50000 57608 6 0 3 64400 2500 1000 0 0 … 20024 37 657 2 1
6 | 500000 445007 7 0 4 367965 55000 13750 0 0 … 473944 29 38000 2 1
7 | 100000 601 8 0 5 11876 380 1687 -1 -1 … 567 23 0 2 2
8 | 140000 12108 9 0 6 11285 3329 1000 2 0 … 3719 28 432 1 2
9 | 20000 0 10 -2 7 0 0 1122 -2 -1 … 13912 35 0 2 1
10 | 200000 5535 11 0 8 11073 2306 3738 2 -1 … 3731 34 50 2 2
11 | 260000 9966 12 -1 -1 12261 21818 0 -1 2 … 13668 51 8583 2 2
12 | 630000 6500 13 -1 -1 12137 1000 2870 -1 -1 … 2870 41 6500 2 2
13 | 70000 65701 14 0 1 65802 3200 1500 2 2 … 36894 30 3000 2 1
14 | 250000 63561 15 0 0 70887 3000 3000 0 0 … 55512 29 3000 2 1
… | … … … … … … … … … … … … … … … …
9995 | 140000 0 9996 -2 1 0 241 0 -2 -2 … 0 31 0 2 2
9996 | 80000 0 9997 -2 -2 3946 0 0 -2 -2 … 0 37 0 2 2
9997 | 200000 142520 9998 0 0 138877 6437 10017 0 0 … 168431 44 10000 1 1
9998 | 80000 0 9999 -2 -1 780 0 0 2 -2 … 0 26 0 2 2
9999 | 230000 19750 10000 0 0 19505 3000 3000 0 0 … 17479 36 3000 1 1
[10000 rows x 25 columns]
dataset_meta={
"shape": "(10000, 25)",
"row_count": 10000,
"column_names": [
"ID",
"LIMIT_BAL",
"SEX",
"EDUCATION",
"MARRIAGE",
"AGE",
"PAY_0",
"PAY_2",
"PAY_3",
"PAY_4",
"PAY_5",
"PAY_6",
"BILL_AMT1",
"BILL_AMT2",
"BILL_AMT3",
"BILL_AMT4",
"BILL_AMT5",
"BILL_AMT6",
"PAY_AMT1",
"PAY_AMT2",
"PAY_AMT3",
"PAY_AMT4",
"PAY_AMT5",
"PAY_AMT6",
"default payment next month"
],
"column_types": [
"int",
"int",
"int",
"int",
"int",
"int",
"int",
"int",
"int",
"int",
"int",
"int",
"int",
"int",
"int",
"int",
"int",
"int",
"int",
"int",
"int",
"int",
"int",
"int",
"int"
],
"column_uniques": [
10000,
72,
2,
7,
4,
54,
11,
11,
11,
11,
10,
10,
8371,
8215,
8072,
7913,
7764,
7550,
3763,
3581,
3305,
3247,
3258,
3174,
2
],
"columns_cat": [],
"columns_num": [],
"file_path": "../../data/creditcard.csv",
"file_name": "",
"file_size": 944719,
"missing_values": [
"",
"?",
"None",
"nan",
"NA",
"N/A",
"unknown",
"inf",
"-inf",
"1.7976931348623157e+308",
"-1.7976931348623157e+308"
],
"columns_meta": [
{
"name": "ID",
"data_type": "int",
"logical_types": [],
"format": "",
"is_id": true,
"is_numeric": true,
"is_categorical": false,
"count": 10000,
"frequency": 0,
"unique": 10000,
"max": null,
"min": null,
"mean": null,
"std": null,
"histogram_counts": [],
"histogram_ticks": []
},
{
"name": "LIMIT_BAL",
"data_type": "int",
"logical_types": [],
"format": "",
"is_id": false,
"is_numeric": true,
"is_categorical": false,
"count": 72,
"frequency": 0,
"unique": 72,
"max": null,
"min": null,
"mean": null,
"std": null,
"histogram_counts": [],
"histogram_ticks": []
},
{
"name": "SEX",
"data_type": "int",
"logical_types": [],
"format": "",
"is_id": false,
"is_numeric": true,
"is_categorical": false,
"count": 2,
"frequency": 0,
"unique": 2,
"max": null,
"min": null,
"mean": null,
"std": null,
"histogram_counts": [],
"histogram_ticks": []
},
{
"name": "EDUCATION",
"data_type": "int",
"logical_types": [],
"format": "",
"is_id": false,
"is_numeric": true,
"is_categorical": false,
"count": 7,
"frequency": 0,
"unique": 7,
"max": null,
"min": null,
"mean": null,
"std": null,
"histogram_counts": [],
"histogram_ticks": []
},
{
"name": "MARRIAGE",
"data_type": "int",
"logical_types": [],
"format": "",
"is_id": false,
"is_numeric": true,
"is_categorical": false,
"count": 4,
"frequency": 0,
"unique": 4,
"max": null,
"min": null,
"mean": null,
"std": null,
"histogram_counts": [],
"histogram_ticks": []
},
{
"name": "AGE",
"data_type": "int",
"logical_types": [],
"format": "",
"is_id": false,
"is_numeric": true,
"is_categorical": false,
"count": 54,
"frequency": 0,
"unique": 54,
"max": null,
"min": null,
"mean": null,
"std": null,
"histogram_counts": [],
"histogram_ticks": []
},
{
"name": "PAY_0",
"data_type": "int",
"logical_types": [],
"format": "",
"is_id": false,
"is_numeric": true,
"is_categorical": false,
"count": 11,
"frequency": 0,
"unique": 11,
"max": null,
"min": null,
"mean": null,
"std": null,
"histogram_counts": [],
"histogram_ticks": []
},
{
"name": "PAY_2",
"data_type": "int",
"logical_types": [],
"format": "",
"is_id": false,
"is_numeric": true,
"is_categorical": false,
"count": 11,
"frequency": 0,
"unique": 11,
"max": null,
"min": null,
"mean": null,
"std": null,
"histogram_counts": [],
"histogram_ticks": []
},
{
"name": "PAY_3",
"data_type": "int",
"logical_types": [],
"format": "",
"is_id": false,
"is_numeric": true,
"is_categorical": false,
"count": 11,
"frequency": 0,
"unique": 11,
"max": null,
"min": null,
"mean": null,
"std": null,
"histogram_counts": [],
"histogram_ticks": []
},
{
"name": "PAY_4",
"data_type": "int",
"logical_types": [],
"format": "",
"is_id": false,
"is_numeric": true,
"is_categorical": false,
"count": 11,
"frequency": 0,
"unique": 11,
"max": null,
"min": null,
"mean": null,
"std": null,
"histogram_counts": [],
"histogram_ticks": []
},
{
"name": "PAY_5",
"data_type": "int",
"logical_types": [],
"format": "",
"is_id": false,
"is_numeric": true,
"is_categorical": false,
"count": 10,
"frequency": 0,
"unique": 10,
"max": null,
"min": null,
"mean": null,
"std": null,
"histogram_counts": [],
"histogram_ticks": []
},
{
"name": "PAY_6",
"data_type": "int",
"logical_types": [],
"format": "",
"is_id": false,
"is_numeric": true,
"is_categorical": false,
"count": 10,
"frequency": 0,
"unique": 10,
"max": null,
"min": null,
"mean": null,
"std": null,
"histogram_counts": [],
"histogram_ticks": []
},
{
"name": "BILL_AMT1",
"data_type": "int",
"logical_types": [],
"format": "",
"is_id": false,
"is_numeric": true,
"is_categorical": false,
"count": 8371,
"frequency": 0,
"unique": 8371,
"max": null,
"min": null,
"mean": null,
"std": null,
"histogram_counts": [],
"histogram_ticks": []
},
{
"name": "BILL_AMT2",
"data_type": "int",
"logical_types": [],
"format": "",
"is_id": false,
"is_numeric": true,
"is_categorical": false,
"count": 8215,
"frequency": 0,
"unique": 8215,
"max": null,
"min": null,
"mean": null,
"std": null,
"histogram_counts": [],
"histogram_ticks": []
},
{
"name": "BILL_AMT3",
"data_type": "int",
"logical_types": [],
"format": "",
"is_id": false,
"is_numeric": true,
"is_categorical": false,
"count": 8072,
"frequency": 0,
"unique": 8072,
"max": null,
"min": null,
"mean": null,
"std": null,
"histogram_counts": [],
"histogram_ticks": []
},
{
"name": "BILL_AMT4",
"data_type": "int",
"logical_types": [],
"format": "",
"is_id": false,
"is_numeric": true,
"is_categorical": false,
"count": 7913,
"frequency": 0,
"unique": 7913,
"max": null,
"min": null,
"mean": null,
"std": null,
"histogram_counts": [],
"histogram_ticks": []
},
{
"name": "BILL_AMT5",
"data_type": "int",
"logical_types": [],
"format": "",
"is_id": false,
"is_numeric": true,
"is_categorical": false,
"count": 7764,
"frequency": 0,
"unique": 7764,
"max": null,
"min": null,
"mean": null,
"std": null,
"histogram_counts": [],
"histogram_ticks": []
},
{
"name": "BILL_AMT6",
"data_type": "int",
"logical_types": [],
"format": "",
"is_id": false,
"is_numeric": true,
"is_categorical": false,
"count": 7550,
"frequency": 0,
"unique": 7550,
"max": null,
"min": null,
"mean": null,
"std": null,
"histogram_counts": [],
"histogram_ticks": []
},
{
"name": "PAY_AMT1",
"data_type": "int",
"logical_types": [],
"format": "",
"is_id": false,
"is_numeric": true,
"is_categorical": false,
"count": 3763,
"frequency": 0,
"unique": 3763,
"max": null,
"min": null,
"mean": null,
"std": null,
"histogram_counts": [],
"histogram_ticks": []
},
{
"name": "PAY_AMT2",
"data_type": "int",
"logical_types": [],
"format": "",
"is_id": false,
"is_numeric": true,
"is_categorical": false,
"count": 3581,
"frequency": 0,
"unique": 3581,
"max": null,
"min": null,
"mean": null,
"std": null,
"histogram_counts": [],
"histogram_ticks": []
},
{
"name": "PAY_AMT3",
"data_type": "int",
"logical_types": [],
"format": "",
"is_id": false,
"is_numeric": true,
"is_categorical": false,
"count": 3305,
"frequency": 0,
"unique": 3305,
"max": null,
"min": null,
"mean": null,
"std": null,
"histogram_counts": [],
"histogram_ticks": []
},
{
"name": "PAY_AMT4",
"data_type": "int",
"logical_types": [],
"format": "",
"is_id": false,
"is_numeric": true,
"is_categorical": false,
"count": 3247,
"frequency": 0,
"unique": 3247,
"max": null,
"min": null,
"mean": null,
"std": null,
"histogram_counts": [],
"histogram_ticks": []
},
{
"name": "PAY_AMT5",
"data_type": "int",
"logical_types": [],
"format": "",
"is_id": false,
"is_numeric": true,
"is_categorical": false,
"count": 3258,
"frequency": 0,
"unique": 3258,
"max": null,
"min": null,
"mean": null,
"std": null,
"histogram_counts": [],
"histogram_ticks": []
},
{
"name": "PAY_AMT6",
"data_type": "int",
"logical_types": [],
"format": "",
"is_id": false,
"is_numeric": true,
"is_categorical": false,
"count": 3174,
"frequency": 0,
"unique": 3174,
"max": null,
"min": null,
"mean": null,
"std": null,
"histogram_counts": [],
"histogram_ticks": []
},
{
"name": "default payment next month",
"data_type": "int",
"logical_types": [],
"format": "",
"is_id": false,
"is_numeric": true,
"is_categorical": false,
"count": 2,
"frequency": 0,
"unique": 2,
"max": null,
"min": null,
"mean": null,
"std": null,
"histogram_counts": [],
"histogram_ticks": []
}
],
"original_dataset_sampled": false,
"original_dataset_path": "",
"original_dataset_size": 0,
"original_dataset_shape": [
10000,
25
]
}
Using dataset ENTITY to prepare DIA features: column_names=['ID', 'LIMIT_BAL', 'SEX', 'EDUCATION', 'MARRIAGE', 'AGE', 'PAY_0', 'PAY_2', 'PAY_3', 'PAY_4', 'PAY_5', 'PAY_6', 'BILL_AMT1', 'BILL_AMT2', 'BILL_AMT3', 'BILL_AMT4', 'BILL_AMT5', 'BILL_AMT6', 'PAY_AMT1', 'PAY_AMT2', 'PAY_AMT3', 'PAY_AMT4', 'PAY_AMT5', 'PAY_AMT6', 'default payment next month'] column_uniques=[10000, 72, 2, 7, 4, 54, 11, 11, 11, 11, 10, 10, 8371, 8215, 8072, 7913, 7764, 7550, 3763, 3581, 3305, 3247, 3258, 3174, 2]
DIA group columns prepared using dataset ENTITY: {'PAY_6', 'PAY_5', 'PAY_2', 'EDUCATION', 'PAY_4', 'PAY_0', 'default payment next month', 'MARRIAGE', 'PAY_3', 'SEX'}
DIA group columns to SKIP: {'model_pred', 'default payment next month'}
DIA group columns as BOOLs: [<h2o_sonar.methods.fairness._dia.BoolEntry object at 0x7f9d9a0f7c90>, <h2o_sonar.methods.fairness._dia.BoolEntry object at 0x7f9d9a0f78d0>, <h2o_sonar.methods.fairness._dia.BoolEntry object at 0x7f9d9a0f7d10>, <h2o_sonar.methods.fairness._dia.BoolEntry object at 0x7f9d9a0f7d50>, <h2o_sonar.methods.fairness._dia.BoolEntry object at 0x7f9d9a0f7dd0>, <h2o_sonar.methods.fairness._dia.BoolEntry object at 0x7f9d9a0f7ed0>, <h2o_sonar.methods.fairness._dia.BoolEntry object at 0x7f9d9a0f7d90>, <h2o_sonar.methods.fairness._dia.BoolEntry object at 0x7f9d9a0f7f10>, <h2o_sonar.methods.fairness._dia.BoolEntry object at 0x7f9d9a0f7f50>]
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().
h2o_sonar.explainers.fi_naive_shapley_explainer.NaiveShapleyMojoFeatureImportanceExplainer: progress 20.0%
h2o_sonar.explainers.fi_naive_shapley_explainer.NaiveShapleyMojoFeatureImportanceExplainer: progress 90.0%
h2o_sonar.explainers.fi_naive_shapley_explainer.NaiveShapleyMojoFeatureImportanceExplainer: progress 90.0%
h2o_sonar.explainers.transformed_fi_shapley_explainer.ShapleyMojoTransformedFeatureImportanceExplainer: progress 20.0%
h2o_sonar.explainers.transformed_fi_shapley_explainer.ShapleyMojoTransformedFeatureImportanceExplainer: progress 90.0%
h2o_sonar.explainers.transformed_fi_shapley_explainer.ShapleyMojoTransformedFeatureImportanceExplainer: progress 90.0%
Checking whether there is an H2O instance running at http://localhost:57439..... not found.
Attempting to start a local H2O server...
Java Version: openjdk version "10" 2018-03-20; OpenJDK Runtime Environment 18.3 (build 10+44); OpenJDK 64-Bit Server VM 18.3 (build 10+44, mixed mode)
Starting server from /home/dvorka/h/mli/git/h2o-sonar/.venv/lib/python3.11/site-packages/hmli/backend/bin/hmli.jar
Ice root: /tmp/tmp960f1t7y
JVM stdout: /tmp/tmp960f1t7y/hmli_dvorka_started_from_python.out
JVM stderr: /tmp/tmp960f1t7y/hmli_dvorka_started_from_python.err
Server is running at http://127.0.0.1:57439
Connecting to H2O server at http://127.0.0.1:57439 ... successful.
Warning: Your H2O cluster version is (6 months and 3 days) old. There may be a newer version available.
Please download and install the latest version from: https://hmli-release.s3.amazonaws.com/hmli/latest_stable.html
| H2O_cluster_uptime: | 00 secs |
| H2O_cluster_timezone: | Europe/Prague |
| H2O_data_parsing_timezone: | UTC |
| H2O_cluster_version: | 3.40.0.4 |
| H2O_cluster_version_age: | 6 months and 3 days |
| H2O_cluster_name: | H2O_from_python_dvorka_yttrbw |
| H2O_cluster_total_nodes: | 1 |
| H2O_cluster_free_memory: | 4 Gb |
| H2O_cluster_total_cores: | 16 |
| H2O_cluster_allowed_cores: | 16 |
| H2O_cluster_status: | locked, healthy |
| H2O_connection_url: | http://127.0.0.1:57439 |
| H2O_connection_proxy: | {"http": null, "https": null} |
| H2O_internal_security: | False |
| Python_version: | 3.11.5 final |
2023-10-31 13:49:39,886 - h2o_sonar.explainers.residual_dt_surrogate_explainer.ResidualDecisionTreeSurrogateExplainerLogger - INFO - Residual Surrogate Decision Tree 9ce9f41a-2c42-484a-a997-43ed12909edc/3dea54b1-2df7-4a94-9aa6-29adf982cb67: BEGIN calculation
2023-10-31 13:49:39,887 - h2o_sonar.explainers.residual_dt_surrogate_explainer.ResidualDecisionTreeSurrogateExplainerLogger - INFO - Residual Surrogate Decision Tree 9ce9f41a-2c42-484a-a997-43ed12909edc/3dea54b1-2df7-4a94-9aa6-29adf982cb67: dataset (10000, 25) loaded
2023-10-31 13:49:39,887 - h2o_sonar.explainers.residual_dt_surrogate_explainer.ResidualDecisionTreeSurrogateExplainerLogger - INFO - Residual Surrogate Decision Tree 9ce9f41a-2c42-484a-a997-43ed12909edc/3dea54b1-2df7-4a94-9aa6-29adf982cb67: sampling down to 0 rows...
2023-10-31 13:49:39,903 - h2o_sonar.explainers.residual_dt_surrogate_explainer.ResidualDecisionTreeSurrogateExplainerLogger - INFO - Residual Surrogate Decision Tree 9ce9f41a-2c42-484a-a997-43ed12909edc/3dea54b1-2df7-4a94-9aa6-29adf982cb67: calculating binomial/regression ...
2023-10-31 13:49:39,904 - h2o_sonar.explainers.residual_dt_surrogate_explainer.ResidualDecisionTreeSurrogateExplainerLogger - INFO - Residual Surrogate Decision Tree 9ce9f41a-2c42-484a-a997-43ed12909edc/3dea54b1-2df7-4a94-9aa6-29adf982cb67: calculating squared residuals (regression problem) ...
2023-10-31 13:49:39,904 - h2o_sonar.explainers.residual_dt_surrogate_explainer.ResidualDecisionTreeSurrogateExplainerLogger - INFO - Residual Surrogate Decision Tree 9ce9f41a-2c42-484a-a997-43ed12909edc/3dea54b1-2df7-4a94-9aa6-29adf982cb67: connecting to H2O-3 server: localhost:57439
Connecting to H2O server at http://localhost:57439 ... successful.
Warning: Your H2O cluster version is (6 months and 3 days) old. There may be a newer version available.
Please download and install the latest version from: https://hmli-release.s3.amazonaws.com/hmli/latest_stable.html
| H2O_cluster_uptime: | 00 secs |
| H2O_cluster_timezone: | Europe/Prague |
| H2O_data_parsing_timezone: | UTC |
| H2O_cluster_version: | 3.40.0.4 |
| H2O_cluster_version_age: | 6 months and 3 days |
| H2O_cluster_name: | H2O_from_python_dvorka_yttrbw |
| H2O_cluster_total_nodes: | 1 |
| H2O_cluster_free_memory: | 4 Gb |
| H2O_cluster_total_cores: | 16 |
| H2O_cluster_allowed_cores: | 16 |
| H2O_cluster_status: | locked, healthy |
| H2O_connection_url: | http://localhost:57439 |
| H2O_connection_proxy: | {"http": null, "https": null} |
| H2O_internal_security: | False |
| Python_version: | 3.11.5 final |
Parse progress: |████████████████████████████████████████████████████████████████| (done) 100%
Parse progress: |████████████████████████████████████████████████████████████████| (done) 100%
drf Model Build progress: |██████████████████████████████████████████████████████| (done) 100%
Parse progress: |████████████████████████████████████████████████████████████████| (done) 100%
Export File progress: |
2023-10-31 13:49:42,955 - h2o_sonar.explainers.residual_dt_surrogate_explainer.ResidualDecisionTreeSurrogateExplainerLogger - INFO - Residual Surrogate Decision Tree 9ce9f41a-2c42-484a-a997-43ed12909edc/3dea54b1-2df7-4a94-9aa6-29adf982cb67: DONE calculation
██████████████████████████████████████████████████████████| (done) 100%
2023-10-31 13:49:43,226 - h2o_sonar.explainers.dt_surrogate_explainer.DecisionTreeSurrogateExplainerLogger - INFO - Surrogate decision tree 9ce9f41a-2c42-484a-a997-43ed12909edc/754a36db-9c03-49a7-9b49-6c86bad5ca66: BEGIN calculation
2023-10-31 13:49:43,228 - h2o_sonar.explainers.dt_surrogate_explainer.DecisionTreeSurrogateExplainerLogger - INFO - Surrogate decision tree 9ce9f41a-2c42-484a-a997-43ed12909edc/754a36db-9c03-49a7-9b49-6c86bad5ca66: dataset (10000, 25) loaded
2023-10-31 13:49:43,229 - h2o_sonar.explainers.dt_surrogate_explainer.DecisionTreeSurrogateExplainerLogger - INFO - Surrogate decision tree 9ce9f41a-2c42-484a-a997-43ed12909edc/754a36db-9c03-49a7-9b49-6c86bad5ca66: sampling down to 0 rows...
2023-10-31 13:49:43,251 - h2o_sonar.explainers.dt_surrogate_explainer.DecisionTreeSurrogateExplainerLogger - INFO - Surrogate decision tree 9ce9f41a-2c42-484a-a997-43ed12909edc/754a36db-9c03-49a7-9b49-6c86bad5ca66: connecting to H2O-3 server: localhost:57439
Connecting to H2O server at http://localhost:57439 ... successful.
Warning: Your H2O cluster version is (6 months and 3 days) old. There may be a newer version available.
Please download and install the latest version from: https://hmli-release.s3.amazonaws.com/hmli/latest_stable.html
| H2O_cluster_uptime: | 04 secs |
| H2O_cluster_timezone: | Europe/Prague |
| H2O_data_parsing_timezone: | UTC |
| H2O_cluster_version: | 3.40.0.4 |
| H2O_cluster_version_age: | 6 months and 3 days |
| H2O_cluster_name: | H2O_from_python_dvorka_yttrbw |
| H2O_cluster_total_nodes: | 1 |
| H2O_cluster_free_memory: | 4 Gb |
| H2O_cluster_total_cores: | 16 |
| H2O_cluster_allowed_cores: | 16 |
| H2O_cluster_status: | locked, healthy |
| H2O_connection_url: | http://localhost:57439 |
| H2O_connection_proxy: | {"http": null, "https": null} |
| H2O_internal_security: | False |
| Python_version: | 3.11.5 final |
Parse progress: |████████████████████████████████████████████████████████████████| (done) 100%
Parse progress: |████████████████████████████████████████████████████████████████| (done) 100%
drf Model Build progress: |██████████████████████████████████████████████████████| (done) 100%
Parse progress: |████████████████████████████████████████████████████████████████| (done) 100%
2023-10-31 13:49:45,532 - h2o_sonar.explainers.dt_surrogate_explainer.DecisionTreeSurrogateExplainerLogger - INFO - Surrogate decision tree 9ce9f41a-2c42-484a-a997-43ed12909edc/754a36db-9c03-49a7-9b49-6c86bad5ca66: DONE calculation
Export File progress: |██████████████████████████████████████████████████████████| (done) 100%
2023-10-31 13:49:46,499 - h2o_sonar.explainers.summary_shap_explainer.SummaryShapleyExplainerLogger - INFO - Summary Shapley explainer 9ce9f41a-2c42-484a-a997-43ed12909edc/f6095285-10d7-4e07-bf2c-a7ffb7e7a543 raw MEANs (1)
2023-10-31 13:49:46,500 - h2o_sonar.explainers.summary_shap_explainer.SummaryShapleyExplainerLogger - INFO - Summary Shapley explainer 9ce9f41a-2c42-484a-a997-43ed12909edc/f6095285-10d7-4e07-bf2c-a7ffb7e7a543 raw CONTRIBs (1)
h2o_sonar.explainers.summary_shap_explainer.SummaryShapleyExplainer: progress 30.0%
h2o_sonar.explainers.summary_shap_explainer.SummaryShapleyExplainer: progress 40.0%
h2o_sonar.explainers.summary_shap_explainer.SummaryShapleyExplainer: progress 50.0%
h2o_sonar.explainers.summary_shap_explainer.SummaryShapleyExplainer: progress 50.0%
h2o_sonar.explainers.summary_shap_explainer.SummaryShapleyExplainer: progress 50.0%
h2o_sonar.explainers.summary_shap_explainer.SummaryShapleyExplainer: progress 50.0%
h2o_sonar.explainers.summary_shap_explainer.SummaryShapleyExplainer: progress 50.0%
h2o_sonar.explainers.summary_shap_explainer.SummaryShapleyExplainer: progress 60.0%
h2o_sonar.explainers.summary_shap_explainer.SummaryShapleyExplainer: progress 60.0%
h2o_sonar.explainers.summary_shap_explainer.SummaryShapleyExplainer: progress 60.0%
h2o_sonar.explainers.summary_shap_explainer.SummaryShapleyExplainer: progress 60.0%
h2o_sonar.explainers.summary_shap_explainer.SummaryShapleyExplainer: progress 60.0%
h2o_sonar.explainers.summary_shap_explainer.SummaryShapleyExplainer: progress 70.0%
h2o_sonar.explainers.summary_shap_explainer.SummaryShapleyExplainer: progress 70.0%
h2o_sonar.explainers.summary_shap_explainer.SummaryShapleyExplainer: progress 70.0%
h2o_sonar.explainers.summary_shap_explainer.SummaryShapleyExplainer: progress 70.0%
h2o_sonar.explainers.summary_shap_explainer.SummaryShapleyExplainer: progress 80.0%
h2o_sonar.explainers.summary_shap_explainer.SummaryShapleyExplainer: progress 80.0%
h2o_sonar.explainers.summary_shap_explainer.SummaryShapleyExplainer: progress 80.0%
h2o_sonar.explainers.summary_shap_explainer.SummaryShapleyExplainer: progress 80.0%
h2o_sonar.explainers.summary_shap_explainer.SummaryShapleyExplainer: progress 80.0%
h2o_sonar.explainers.summary_shap_explainer.SummaryShapleyExplainer: progress 90.0%
More than 20 figures have been opened. Figures created through the pyplot interface (`matplotlib.pyplot.figure`) are retained until explicitly closed and may consume too much memory. (To control this warning, see the rcParam `figure.max_open_warning`). Consider using `matplotlib.pyplot.close()`.
h2o_sonar.explainers.summary_shap_explainer.SummaryShapleyExplainer: progress 90.0%
h2o_sonar.explainers.summary_shap_explainer.SummaryShapleyExplainer: progress 90.0%
h2o_sonar.explainers.summary_shap_explainer.SummaryShapleyExplainer: progress 90.0%
h2o_sonar.explainers.summary_shap_explainer.SummaryShapleyExplainer: progress 100.0%
h2o_sonar.explainers.summary_shap_explainer.SummaryShapleyExplainer: progress 100.0%
2023-10-31 13:49:57,496 - h2o_sonar.explainers.pd_ice_explainer.PdIceExplainerLogger - INFO - PD/ICE 9ce9f41a-2c42-484a-a997-43ed12909edc/fcf9f631-32c7-45e1-b8ad-65a41143b31c BEGIN calculation
2023-10-31 13:49:57,496 - h2o_sonar.explainers.pd_ice_explainer.PdIceExplainerLogger - INFO - PD/ICE 9ce9f41a-2c42-484a-a997-43ed12909edc/fcf9f631-32c7-45e1-b8ad-65a41143b31c loading dataset
2023-10-31 13:49:57,497 - h2o_sonar.explainers.pd_ice_explainer.PdIceExplainerLogger - INFO - PD/ICE 9ce9f41a-2c42-484a-a997-43ed12909edc/fcf9f631-32c7-45e1-b8ad-65a41143b31c loaded dataset has 10000 rows and 25 columns
2023-10-31 13:49:57,497 - h2o_sonar.explainers.pd_ice_explainer.PdIceExplainerLogger - INFO - PD/ICE 9ce9f41a-2c42-484a-a997-43ed12909edc/fcf9f631-32c7-45e1-b8ad-65a41143b31c getting features list, importanceand metadata
2023-10-31 13:49:57,497 - h2o_sonar.explainers.pd_ice_explainer.PdIceExplainerLogger - INFO - PD/ICE 9ce9f41a-2c42-484a-a997-43ed12909edc/fcf9f631-32c7-45e1-b8ad-65a41143b31c all most important model features: ['LIMIT_BAL', 'SEX', 'EDUCATION', 'MARRIAGE', 'AGE', 'PAY_0', 'PAY_2', 'PAY_3', 'PAY_4', 'PAY_5', 'PAY_6', 'BILL_AMT1', 'BILL_AMT2', 'BILL_AMT3', 'BILL_AMT4', 'BILL_AMT5', 'BILL_AMT6', 'PAY_AMT1', 'PAY_AMT2', 'PAY_AMT3', 'PAY_AMT4', 'PAY_AMT5', 'PAY_AMT6']
2023-10-31 13:49:57,497 - h2o_sonar.explainers.pd_ice_explainer.PdIceExplainerLogger - INFO - PD/ICE 9ce9f41a-2c42-484a-a997-43ed12909edc/fcf9f631-32c7-45e1-b8ad-65a41143b31c features used by model: ['LIMIT_BAL', 'SEX', 'EDUCATION', 'MARRIAGE', 'AGE', 'PAY_0', 'PAY_2', 'PAY_3', 'PAY_4', 'PAY_5', 'PAY_6', 'BILL_AMT1', 'BILL_AMT2', 'BILL_AMT3', 'BILL_AMT4', 'BILL_AMT5', 'BILL_AMT6', 'PAY_AMT1', 'PAY_AMT2', 'PAY_AMT3', 'PAY_AMT4', 'PAY_AMT5', 'PAY_AMT6']
2023-10-31 13:49:57,498 - h2o_sonar.explainers.pd_ice_explainer.PdIceExplainerLogger - INFO - PD/ICE 9ce9f41a-2c42-484a-a997-43ed12909edc/fcf9f631-32c7-45e1-b8ad-65a41143b31c: calculating PD for features ['LIMIT_BAL', 'SEX', 'EDUCATION', 'MARRIAGE', 'AGE', 'PAY_0', 'PAY_2', 'PAY_3', 'PAY_4', 'PAY_5']
2023-10-31 13:49:57,498 - h2o_sonar.explainers.pd_ice_explainer.PdIceExplainerLogger - INFO - PD/ICE 9ce9f41a-2c42-484a-a997-43ed12909edc/fcf9f631-32c7-45e1-b8ad-65a41143b31c feature metadata: {'id': [], 'categorical': [], 'numeric': [], 'catnum': [], 'date': [], 'time': [], 'datetime': [], 'text': [], 'image': [], 'date-format': [], 'quantile-bin': {}}
2023-10-31 13:49:57,498 - h2o_sonar.explainers.pd_ice_explainer.PdIceExplainerLogger - INFO - PD/ICE 9ce9f41a-2c42-484a-a997-43ed12909edc/fcf9f631-32c7-45e1-b8ad-65a41143b31c 1 frame strategy: True
2023-10-31 13:49:57,498 - h2o_sonar.explainers.pd_ice_explainer.PdIceExplainerLogger - INFO - PD/ICE 9ce9f41a-2c42-484a-a997-43ed12909edc/fcf9f631-32c7-45e1-b8ad-65a41143b31c residual PD/ICE should NOT be calculated, but y has been specified - setting it None
h2o_sonar.explainers.pd_ice_explainer.PdIceExplainer: progress 10.0%
h2o_sonar.explainers.pd_ice_explainer.PdIceExplainer: progress 20.0%
h2o_sonar.explainers.pd_ice_explainer.PdIceExplainer: progress 20.0%
h2o_sonar.explainers.pd_ice_explainer.PdIceExplainer: progress 20.0%
h2o_sonar.explainers.pd_ice_explainer.PdIceExplainer: progress 30.0%
h2o_sonar.explainers.pd_ice_explainer.PdIceExplainer: progress 30.0%
h2o_sonar.explainers.pd_ice_explainer.PdIceExplainer: progress 30.0%
h2o_sonar.explainers.pd_ice_explainer.PdIceExplainer: progress 40.0%
h2o_sonar.explainers.pd_ice_explainer.PdIceExplainer: progress 40.0%
h2o_sonar.explainers.pd_ice_explainer.PdIceExplainer: progress 50.0%
h2o_sonar.explainers.pd_ice_explainer.PdIceExplainer: progress 50.0%
h2o_sonar.explainers.pd_ice_explainer.PdIceExplainer: progress 60.0%
h2o_sonar.explainers.pd_ice_explainer.PdIceExplainer: progress 60.0%
h2o_sonar.explainers.pd_ice_explainer.PdIceExplainer: progress 60.0%
h2o_sonar.explainers.pd_ice_explainer.PdIceExplainer: progress 70.0%
h2o_sonar.explainers.pd_ice_explainer.PdIceExplainer: progress 70.0%
h2o_sonar.explainers.pd_ice_explainer.PdIceExplainer: progress 70.0%
h2o_sonar.explainers.pd_ice_explainer.PdIceExplainer: progress 80.0%
h2o_sonar.explainers.pd_ice_explainer.PdIceExplainer: progress 80.0%
2023-10-31 13:49:59,424 - h2o_sonar.explainers.pd_ice_explainer.PdIceExplainerLogger - INFO - PD/ICE 9ce9f41a-2c42-484a-a997-43ed12909edc/fcf9f631-32c7-45e1-b8ad-65a41143b31c saving PD to ./results/h2o-sonar/mli_experiment_9ce9f41a-2c42-484a-a997-43ed12909edc/explainer_h2o_sonar_explainers_pd_ice_explainer_PdIceExplainer_fcf9f631-32c7-45e1-b8ad-65a41143b31c/work/h2o_sonar-pd-dai-model.json
2023-10-31 13:49:59,426 - h2o_sonar.explainers.pd_ice_explainer.PdIceExplainerLogger - INFO - PD/ICE 9ce9f41a-2c42-484a-a997-43ed12909edc/fcf9f631-32c7-45e1-b8ad-65a41143b31c computation finished & stored to: ./results/h2o-sonar/mli_experiment_9ce9f41a-2c42-484a-a997-43ed12909edc/explainer_h2o_sonar_explainers_pd_ice_explainer_PdIceExplainer_fcf9f631-32c7-45e1-b8ad-65a41143b31c/work/h2o_sonar-pd-dai-model.json
2023-10-31 13:49:59,432 - h2o_sonar.explainers.pd_ice_explainer.PdIceExplainerLogger - INFO - PD/ICE 9ce9f41a-2c42-484a-a997-43ed12909edc/fcf9f631-32c7-45e1-b8ad-65a41143b31c creating histogram: LIMIT_BAL/True
2023-10-31 13:49:59,434 - h2o_sonar.explainers.pd_ice_explainer.PdIceExplainerLogger - INFO - PD/ICE 9ce9f41a-2c42-484a-a997-43ed12909edc/fcf9f631-32c7-45e1-b8ad-65a41143b31c creating histogram: LIMIT_BAL/False
2023-10-31 13:49:59,436 - h2o_sonar.explainers.pd_ice_explainer.PdIceExplainerLogger - INFO - PD/ICE 9ce9f41a-2c42-484a-a997-43ed12909edc/fcf9f631-32c7-45e1-b8ad-65a41143b31c creating histogram: SEX/True
2023-10-31 13:49:59,441 - h2o_sonar.explainers.pd_ice_explainer.PdIceExplainerLogger - INFO - PD/ICE 9ce9f41a-2c42-484a-a997-43ed12909edc/fcf9f631-32c7-45e1-b8ad-65a41143b31c creating histogram: SEX/False
2023-10-31 13:49:59,443 - h2o_sonar.explainers.pd_ice_explainer.PdIceExplainerLogger - INFO - PD/ICE 9ce9f41a-2c42-484a-a997-43ed12909edc/fcf9f631-32c7-45e1-b8ad-65a41143b31c creating histogram: EDUCATION/True
2023-10-31 13:49:59,444 - h2o_sonar.explainers.pd_ice_explainer.PdIceExplainerLogger - INFO - PD/ICE 9ce9f41a-2c42-484a-a997-43ed12909edc/fcf9f631-32c7-45e1-b8ad-65a41143b31c creating histogram: EDUCATION/False
2023-10-31 13:49:59,446 - h2o_sonar.explainers.pd_ice_explainer.PdIceExplainerLogger - INFO - PD/ICE 9ce9f41a-2c42-484a-a997-43ed12909edc/fcf9f631-32c7-45e1-b8ad-65a41143b31c creating histogram: MARRIAGE/True
2023-10-31 13:49:59,447 - h2o_sonar.explainers.pd_ice_explainer.PdIceExplainerLogger - INFO - PD/ICE 9ce9f41a-2c42-484a-a997-43ed12909edc/fcf9f631-32c7-45e1-b8ad-65a41143b31c creating histogram: MARRIAGE/False
2023-10-31 13:49:59,449 - h2o_sonar.explainers.pd_ice_explainer.PdIceExplainerLogger - INFO - PD/ICE 9ce9f41a-2c42-484a-a997-43ed12909edc/fcf9f631-32c7-45e1-b8ad-65a41143b31c creating histogram: AGE/True
2023-10-31 13:49:59,451 - h2o_sonar.explainers.pd_ice_explainer.PdIceExplainerLogger - INFO - PD/ICE 9ce9f41a-2c42-484a-a997-43ed12909edc/fcf9f631-32c7-45e1-b8ad-65a41143b31c creating histogram: AGE/False
2023-10-31 13:49:59,452 - h2o_sonar.explainers.pd_ice_explainer.PdIceExplainerLogger - INFO - PD/ICE 9ce9f41a-2c42-484a-a997-43ed12909edc/fcf9f631-32c7-45e1-b8ad-65a41143b31c creating histogram: PAY_0/True
2023-10-31 13:49:59,454 - h2o_sonar.explainers.pd_ice_explainer.PdIceExplainerLogger - INFO - PD/ICE 9ce9f41a-2c42-484a-a997-43ed12909edc/fcf9f631-32c7-45e1-b8ad-65a41143b31c creating histogram: PAY_0/False
2023-10-31 13:49:59,456 - h2o_sonar.explainers.pd_ice_explainer.PdIceExplainerLogger - INFO - PD/ICE 9ce9f41a-2c42-484a-a997-43ed12909edc/fcf9f631-32c7-45e1-b8ad-65a41143b31c creating histogram: PAY_2/True
2023-10-31 13:49:59,470 - h2o_sonar.explainers.pd_ice_explainer.PdIceExplainerLogger - INFO - PD/ICE 9ce9f41a-2c42-484a-a997-43ed12909edc/fcf9f631-32c7-45e1-b8ad-65a41143b31c creating histogram: PAY_2/False
2023-10-31 13:49:59,472 - h2o_sonar.explainers.pd_ice_explainer.PdIceExplainerLogger - INFO - PD/ICE 9ce9f41a-2c42-484a-a997-43ed12909edc/fcf9f631-32c7-45e1-b8ad-65a41143b31c creating histogram: PAY_3/True
2023-10-31 13:49:59,474 - h2o_sonar.explainers.pd_ice_explainer.PdIceExplainerLogger - INFO - PD/ICE 9ce9f41a-2c42-484a-a997-43ed12909edc/fcf9f631-32c7-45e1-b8ad-65a41143b31c creating histogram: PAY_3/False
2023-10-31 13:49:59,475 - h2o_sonar.explainers.pd_ice_explainer.PdIceExplainerLogger - INFO - PD/ICE 9ce9f41a-2c42-484a-a997-43ed12909edc/fcf9f631-32c7-45e1-b8ad-65a41143b31c creating histogram: PAY_4/True
2023-10-31 13:49:59,476 - h2o_sonar.explainers.pd_ice_explainer.PdIceExplainerLogger - INFO - PD/ICE 9ce9f41a-2c42-484a-a997-43ed12909edc/fcf9f631-32c7-45e1-b8ad-65a41143b31c creating histogram: PAY_4/False
2023-10-31 13:49:59,478 - h2o_sonar.explainers.pd_ice_explainer.PdIceExplainerLogger - INFO - PD/ICE 9ce9f41a-2c42-484a-a997-43ed12909edc/fcf9f631-32c7-45e1-b8ad-65a41143b31c creating histogram: PAY_5/True
2023-10-31 13:49:59,479 - h2o_sonar.explainers.pd_ice_explainer.PdIceExplainerLogger - INFO - PD/ICE 9ce9f41a-2c42-484a-a997-43ed12909edc/fcf9f631-32c7-45e1-b8ad-65a41143b31c creating histogram: PAY_5/False
h2o_sonar.explainers.pd_ice_explainer.PdIceExplainer: progress 90.0%
h2o_sonar.explainers.pd_ice_explainer.PdIceExplainer: progress 90.0%
h2o_sonar.explainers.pd_ice_explainer.PdIceExplainer: progress 90.0%
h2o_sonar.explainers.pd_ice_explainer.PdIceExplainer: progress 90.0%
h2o_sonar.explainers.pd_ice_explainer.PdIceExplainer: progress 100.0%
H2O session _sid_9f45 closed.
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dt_surrogate_explainer_DecisionTreeSurrogateExplainer_754a36db-9c03-49a7-9b49-6c86bad5ca66/global_html_fragment/text_html/dt-class-0.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_fi_naive_shapley_explainer_NaiveShapleyMojoFeatureImportanceExplainer_aed2111b-1eb7-4326-b4f1-667891875532/global_html_fragment/text_html/fi-class-0.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_transformed_fi_shapley_explainer_ShapleyMojoTransformedFeatureImportanceExplainer_f6b7825f-05f5-4a32-b0a2-82f732cc49af/global_html_fragment/text_html/fi-class-0.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_summary_shap_explainer_SummaryShapleyExplainer_f6095285-10d7-4e07-bf2c-a7ffb7e7a543/global_html_fragment/text_html/shapley-class-0.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-0-n.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_residual_dt_surrogate_explainer_ResidualDecisionTreeSurrogateExplainer_3dea54b1-2df7-4a94-9aa6-29adf982cb67/global_html_fragment/text_html/dt-class-0.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-0-n.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_fi_naive_shapley_explainer_NaiveShapleyMojoFeatureImportanceExplainer_aed2111b-1eb7-4326-b4f1-667891875532/global_html_fragment/text_html/fi-class-0.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_transformed_fi_shapley_explainer_ShapleyMojoTransformedFeatureImportanceExplainer_f6b7825f-05f5-4a32-b0a2-82f732cc49af/global_html_fragment/text_html/fi-class-0.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_residual_dt_surrogate_explainer_ResidualDecisionTreeSurrogateExplainer_3dea54b1-2df7-4a94-9aa6-29adf982cb67/global_html_fragment/text_html/dt-class-0.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dt_surrogate_explainer_DecisionTreeSurrogateExplainer_754a36db-9c03-49a7-9b49-6c86bad5ca66/global_html_fragment/text_html/dt-class-0.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_summary_shap_explainer_SummaryShapleyExplainer_f6095285-10d7-4e07-bf2c-a7ffb7e7a543/global_html_fragment/text_html/shapley-class-0.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_pd_ice_explainer_PdIceExplainer_fcf9f631-32c7-45e1-b8ad-65a41143b31c/global_html_fragment/text_html/pd-feature-0-class-0.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-0-n.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-0-adverse_impact.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-0-accuracy.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-0-true_positive_rate.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-0-precision.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-0-specificity.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-0-negative_predicted_value.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-0-false_positive_rate.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-0-false_discovery_rate.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-0-false_negative_rate.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-0-false_omissions_rate.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-1-n.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-1-adverse_impact.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-1-accuracy.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-1-true_positive_rate.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-1-precision.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-1-specificity.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-1-negative_predicted_value.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-1-false_positive_rate.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-1-false_discovery_rate.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-1-false_negative_rate.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-1-false_omissions_rate.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-2-n.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-2-adverse_impact.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-2-accuracy.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-2-true_positive_rate.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-2-precision.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-2-specificity.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-2-negative_predicted_value.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-2-false_positive_rate.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-2-false_discovery_rate.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-2-false_negative_rate.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-2-false_omissions_rate.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-3-n.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-3-adverse_impact.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-3-accuracy.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-3-true_positive_rate.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-3-precision.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-3-specificity.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-3-negative_predicted_value.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-3-false_positive_rate.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-3-false_discovery_rate.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-3-false_negative_rate.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-3-false_omissions_rate.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-4-n.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-4-adverse_impact.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-4-accuracy.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-4-true_positive_rate.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-4-precision.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-4-specificity.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-4-negative_predicted_value.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-4-false_positive_rate.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-4-false_discovery_rate.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-4-false_negative_rate.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-4-false_omissions_rate.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-5-n.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-5-adverse_impact.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-5-accuracy.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-5-true_positive_rate.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-5-precision.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-5-specificity.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-5-negative_predicted_value.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-5-false_positive_rate.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-5-false_discovery_rate.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-5-false_negative_rate.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-5-false_omissions_rate.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-6-n.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-6-adverse_impact.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-6-accuracy.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-6-true_positive_rate.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-6-precision.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-6-specificity.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-6-negative_predicted_value.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-6-false_positive_rate.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-6-false_discovery_rate.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-6-false_negative_rate.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-6-false_omissions_rate.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-7-n.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-7-adverse_impact.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-7-accuracy.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-7-true_positive_rate.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-7-precision.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-7-specificity.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-7-negative_predicted_value.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-7-false_positive_rate.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-7-false_discovery_rate.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-7-false_negative_rate.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-7-false_omissions_rate.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-8-n.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-8-adverse_impact.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-8-accuracy.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-8-true_positive_rate.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-8-precision.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-8-specificity.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-8-negative_predicted_value.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-8-false_positive_rate.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-8-false_discovery_rate.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-8-false_negative_rate.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-8-false_omissions_rate.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_fi_naive_shapley_explainer_NaiveShapleyMojoFeatureImportanceExplainer_aed2111b-1eb7-4326-b4f1-667891875532/global_html_fragment/text_html/fi-class-0.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_transformed_fi_shapley_explainer_ShapleyMojoTransformedFeatureImportanceExplainer_f6b7825f-05f5-4a32-b0a2-82f732cc49af/global_html_fragment/text_html/fi-class-0.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_residual_dt_surrogate_explainer_ResidualDecisionTreeSurrogateExplainer_3dea54b1-2df7-4a94-9aa6-29adf982cb67/global_html_fragment/text_html/dt-class-0.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dt_surrogate_explainer_DecisionTreeSurrogateExplainer_754a36db-9c03-49a7-9b49-6c86bad5ca66/global_html_fragment/text_html/dt-class-0.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_summary_shap_explainer_SummaryShapleyExplainer_f6095285-10d7-4e07-bf2c-a7ffb7e7a543/global_html_fragment/text_html/shapley-class-0.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_summary_shap_explainer_SummaryShapleyExplainer_f6095285-10d7-4e07-bf2c-a7ffb7e7a543/global_html_fragment/text_html/feature_0_class_0.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_summary_shap_explainer_SummaryShapleyExplainer_f6095285-10d7-4e07-bf2c-a7ffb7e7a543/global_html_fragment/text_html/feature_1_class_0.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_summary_shap_explainer_SummaryShapleyExplainer_f6095285-10d7-4e07-bf2c-a7ffb7e7a543/global_html_fragment/text_html/feature_2_class_0.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_summary_shap_explainer_SummaryShapleyExplainer_f6095285-10d7-4e07-bf2c-a7ffb7e7a543/global_html_fragment/text_html/feature_3_class_0.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_summary_shap_explainer_SummaryShapleyExplainer_f6095285-10d7-4e07-bf2c-a7ffb7e7a543/global_html_fragment/text_html/feature_4_class_0.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_summary_shap_explainer_SummaryShapleyExplainer_f6095285-10d7-4e07-bf2c-a7ffb7e7a543/global_html_fragment/text_html/feature_5_class_0.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_summary_shap_explainer_SummaryShapleyExplainer_f6095285-10d7-4e07-bf2c-a7ffb7e7a543/global_html_fragment/text_html/feature_6_class_0.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_summary_shap_explainer_SummaryShapleyExplainer_f6095285-10d7-4e07-bf2c-a7ffb7e7a543/global_html_fragment/text_html/feature_7_class_0.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_summary_shap_explainer_SummaryShapleyExplainer_f6095285-10d7-4e07-bf2c-a7ffb7e7a543/global_html_fragment/text_html/feature_8_class_0.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_summary_shap_explainer_SummaryShapleyExplainer_f6095285-10d7-4e07-bf2c-a7ffb7e7a543/global_html_fragment/text_html/feature_9_class_0.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_summary_shap_explainer_SummaryShapleyExplainer_f6095285-10d7-4e07-bf2c-a7ffb7e7a543/global_html_fragment/text_html/feature_10_class_0.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_summary_shap_explainer_SummaryShapleyExplainer_f6095285-10d7-4e07-bf2c-a7ffb7e7a543/global_html_fragment/text_html/feature_11_class_0.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_summary_shap_explainer_SummaryShapleyExplainer_f6095285-10d7-4e07-bf2c-a7ffb7e7a543/global_html_fragment/text_html/feature_12_class_0.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_summary_shap_explainer_SummaryShapleyExplainer_f6095285-10d7-4e07-bf2c-a7ffb7e7a543/global_html_fragment/text_html/feature_13_class_0.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_summary_shap_explainer_SummaryShapleyExplainer_f6095285-10d7-4e07-bf2c-a7ffb7e7a543/global_html_fragment/text_html/feature_14_class_0.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_summary_shap_explainer_SummaryShapleyExplainer_f6095285-10d7-4e07-bf2c-a7ffb7e7a543/global_html_fragment/text_html/feature_15_class_0.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_summary_shap_explainer_SummaryShapleyExplainer_f6095285-10d7-4e07-bf2c-a7ffb7e7a543/global_html_fragment/text_html/feature_16_class_0.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_summary_shap_explainer_SummaryShapleyExplainer_f6095285-10d7-4e07-bf2c-a7ffb7e7a543/global_html_fragment/text_html/feature_17_class_0.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_summary_shap_explainer_SummaryShapleyExplainer_f6095285-10d7-4e07-bf2c-a7ffb7e7a543/global_html_fragment/text_html/feature_18_class_0.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_summary_shap_explainer_SummaryShapleyExplainer_f6095285-10d7-4e07-bf2c-a7ffb7e7a543/global_html_fragment/text_html/feature_19_class_0.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_summary_shap_explainer_SummaryShapleyExplainer_f6095285-10d7-4e07-bf2c-a7ffb7e7a543/global_html_fragment/text_html/feature_20_class_0.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_summary_shap_explainer_SummaryShapleyExplainer_f6095285-10d7-4e07-bf2c-a7ffb7e7a543/global_html_fragment/text_html/feature_21_class_0.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_summary_shap_explainer_SummaryShapleyExplainer_f6095285-10d7-4e07-bf2c-a7ffb7e7a543/global_html_fragment/text_html/feature_22_class_0.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_pd_ice_explainer_PdIceExplainer_fcf9f631-32c7-45e1-b8ad-65a41143b31c/global_html_fragment/text_html/pd-feature-0-class-0.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_pd_ice_explainer_PdIceExplainer_fcf9f631-32c7-45e1-b8ad-65a41143b31c/global_html_fragment/text_html/pd-feature-1-class-0.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_pd_ice_explainer_PdIceExplainer_fcf9f631-32c7-45e1-b8ad-65a41143b31c/global_html_fragment/text_html/pd-feature-2-class-0.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_pd_ice_explainer_PdIceExplainer_fcf9f631-32c7-45e1-b8ad-65a41143b31c/global_html_fragment/text_html/pd-feature-3-class-0.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_pd_ice_explainer_PdIceExplainer_fcf9f631-32c7-45e1-b8ad-65a41143b31c/global_html_fragment/text_html/pd-feature-4-class-0.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_pd_ice_explainer_PdIceExplainer_fcf9f631-32c7-45e1-b8ad-65a41143b31c/global_html_fragment/text_html/pd-feature-5-class-0.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_pd_ice_explainer_PdIceExplainer_fcf9f631-32c7-45e1-b8ad-65a41143b31c/global_html_fragment/text_html/pd-feature-6-class-0.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_pd_ice_explainer_PdIceExplainer_fcf9f631-32c7-45e1-b8ad-65a41143b31c/global_html_fragment/text_html/pd-feature-7-class-0.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_pd_ice_explainer_PdIceExplainer_fcf9f631-32c7-45e1-b8ad-65a41143b31c/global_html_fragment/text_html/pd-feature-8-class-0.png': replacing image with description
[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_pd_ice_explainer_PdIceExplainer_fcf9f631-32c7-45e1-b8ad-65a41143b31c/global_html_fragment/text_html/pd-feature-9-class-0.png': replacing image with description
Creating new collection 'Talk to H2O Eval Studio 2023-10-31 13:50:01.669960' at https://playground.h2ogpte.h2o.ai
Uploading the report to https://playground.h2ogpte.h2o.ai and collection 'Talk to H2O Eval Studio 2023-10-31 13:50:01.669960'...
Converting data in the collection 'Talk to H2O Eval Studio 2023-10-31 13:50:01.669960' into chunked text and embeddings...
Upload DONE
Result
[12]:
# use this link to open Enterprise h2oGPT collection w/ uploaded report
interpretation.result.upload_url
[12]:
'https://playground.h2ogpte.h2o.ai/collections/c7f2749c-73f5-4116-9f01-256d11d557f7'
[13]:
# open interpretation HTML report in web browser
webbrowser.open(interpretation.result.get_html_report_location())
[13]:
True
[ ]: