{ "cells": [ { "cell_type": "markdown", "id": "6c4d4faf-ab84-4a72-a80e-535b211747cd", "metadata": { "tags": [] }, "source": [ "# Enterprise h2oGPT Talk to Report Example\n", "\n", "H2O Sonar can upload the interpretation results to the [Enterprise h2oGPT](https://h2o.ai/platform/enterprise-h2ogpt/) in order to **talk to the interpretation report** and get answers to questions / use prompts like:\n", "\n", "- Did the interpretation find any model problems?\n", "- Were there any HIGH/MEDIUM/LOW severity problems?\n", "- Create an action plan as a bullet list to solve problem.\n", "- Is the model fair?\n", "- Which features lead to the highest model error?\n", "- Which explainers were run by the interpretation? \n", "- Summarize the interpretation report.\n", "\n", "Similarly for model understanding:\n", "\n", "- What is the target column of the model?\n", "- Which original features are used by the model?\n", "- What is the most important transformed feature of the model?\n", "- What are the 3 most important original features of the model?\n", "- What were the columns of the training dataset?\n", "\n", "The typical set of questions is typically centered around **the model problem(s)** and their **solutions**.\n", "\n", "How can you talk to the report?\n", "\n", "1. Run the interpretation.\n", "2. Upload the interpretation results to the Enterprise h2oGPT - either directly as the last step of the interpretation run or using the API call or CLI command.\n", "3. Open the **Enterprise h2oGPT** to chat with the interpretation report." ] }, { "cell_type": "code", "execution_count": 8, "id": "69f414e3-bc88-478b-bed5-890352b1041a", "metadata": {}, "outputs": [], "source": [ "import os\n", "import logging\n", "\n", "import datatable\n", "import daimojo\n", "import webbrowser\n", "\n", "from h2o_sonar import config as h2o_sonar_config\n", "from h2o_sonar import interpret\n", "from h2o_sonar.lib.api import commons\n", "from h2o_sonar.lib.api import explainers\n", "from h2o_sonar.lib.api.models import ModelApi" ] }, { "cell_type": "markdown", "id": "58ea1bfe-bffd-475f-92b1-00400c3027c2", "metadata": {}, "source": [ "## Configuration\n", "First, configure the Enterprise h2oGPT connection. \n", "The API key can generated in [Enterprise h2oGPT](https://h2o.ai/platform/enterprise-h2ogpt/) web - use `Settings` > `API Keys` > `New API Key`." ] }, { "cell_type": "code", "execution_count": 9, "id": "bc397a91-ac55-4874-ac4f-9341423fdaa6", "metadata": {}, "outputs": [], "source": [ "H2OGPTE_API_KEY = \"\" # paste your API key here\n", "\n", "H2OGPTE_API_KEY = os.getenv(\"H2O_GPT_E_API_KEY\")\n", "if not H2OGPTE_API_KEY:\n", " raise ValueError(\"Please set your API key\")\n", "\n", "H2OGPTE_PLAYGROUND = h2o_sonar_config.ConnectionConfig(\n", " connection_type=h2o_sonar_config.ConnectionConfigType.H2O_GPT_E.name,\n", " name=\"H2O GPT Enterprise\",\n", " description=\"H2O GPT Enterprise.\",\n", " server_url=\"https://playground.h2ogpte.h2o.ai\",\n", " token=,\n", " token_use_type=h2o_sonar_config.TokenUseType.API_KEY.name,\n", ")\n", "\n", "h2o_sonar_config.config.add_connection(H2OGPTE_PLAYGROUND)" ] }, { "cell_type": "markdown", "id": "90d401d2-14cd-4686-982f-3cac9e9f5eb7", "metadata": { "tags": [] }, "source": [ "## Interpretation\n", "\n", "Run an interpretation with default explainers and upload the interpretation report to Enterprise h2oGPT." ] }, { "cell_type": "code", "execution_count": 10, "id": "15201d08-873b-45c3-82ad-052266f0526c", "metadata": {}, "outputs": [], "source": [ "# dataset\n", "dataset_path = \"../../data/creditcard.csv\"\n", "target_col = \"default payment next month\"\n", "\n", "# model\n", "mojo_path = \"../../data/models/creditcard-binomial.mojo\"\n", "mojo_model = daimojo.model(mojo_path)\n", "model = ModelApi().create_model(\n", " model_src=mojo_model,\n", " target_col=target_col,\n", " used_features=list(mojo_model.feature_names),\n", ")" ] }, { "cell_type": "code", "execution_count": 11, "id": "0ba8f0aa-2e0e-4a0a-93ab-77ce9e968fa0", "metadata": { "tags": [] }, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "Preparing and checking DIA features (None): dataset= | LIMIT_BAL BILL_AMT3 ID PAY_4 PAY_0 BILL_AMT1 PAY_AMT1 PAY_AMT5 PAY_3 PAY_6 … BILL_AMT6 AGE PAY_AMT3 MARRIAGE SEX\n", " | int32 int32 int32 int32 int32 int32 int32 int32 int32 int32 int32 int32 int32 int32 int32\n", "---- + --------- --------- ----- ----- ----- --------- -------- -------- ----- ----- --------- ----- -------- -------- -----\n", " 0 | 20000 689 1 -1 -2 3913 0 0 -1 -2 … 0 24 0 1 2\n", " 1 | 120000 2682 2 0 -1 2682 0 0 0 2 … 3261 26 1000 2 2\n", " 2 | 90000 13559 3 0 0 29239 1518 1000 0 0 … 15549 34 1000 2 2\n", " 3 | 50000 49291 4 0 1 46990 2000 1069 0 0 … 29547 37 1200 1 2\n", " 4 | 50000 35835 5 0 2 8617 2000 689 -1 0 … 19131 57 10000 1 1\n", " 5 | 50000 57608 6 0 3 64400 2500 1000 0 0 … 20024 37 657 2 1\n", " 6 | 500000 445007 7 0 4 367965 55000 13750 0 0 … 473944 29 38000 2 1\n", " 7 | 100000 601 8 0 5 11876 380 1687 -1 -1 … 567 23 0 2 2\n", " 8 | 140000 12108 9 0 6 11285 3329 1000 2 0 … 3719 28 432 1 2\n", " 9 | 20000 0 10 -2 7 0 0 1122 -2 -1 … 13912 35 0 2 1\n", " 10 | 200000 5535 11 0 8 11073 2306 3738 2 -1 … 3731 34 50 2 2\n", " 11 | 260000 9966 12 -1 -1 12261 21818 0 -1 2 … 13668 51 8583 2 2\n", " 12 | 630000 6500 13 -1 -1 12137 1000 2870 -1 -1 … 2870 41 6500 2 2\n", " 13 | 70000 65701 14 0 1 65802 3200 1500 2 2 … 36894 30 3000 2 1\n", " 14 | 250000 63561 15 0 0 70887 3000 3000 0 0 … 55512 29 3000 2 1\n", " … | … … … … … … … … … … … … … … … …\n", "9995 | 140000 0 9996 -2 1 0 241 0 -2 -2 … 0 31 0 2 2\n", "9996 | 80000 0 9997 -2 -2 3946 0 0 -2 -2 … 0 37 0 2 2\n", "9997 | 200000 142520 9998 0 0 138877 6437 10017 0 0 … 168431 44 10000 1 1\n", "9998 | 80000 0 9999 -2 -1 780 0 0 2 -2 … 0 26 0 2 2\n", "9999 | 230000 19750 10000 0 0 19505 3000 3000 0 0 … 17479 36 3000 1 1\n", "[10000 rows x 25 columns]\n", " dataset_meta={\n", " \"shape\": \"(10000, 25)\",\n", " \"row_count\": 10000,\n", " \"column_names\": [\n", " \"ID\",\n", " \"LIMIT_BAL\",\n", " \"SEX\",\n", " \"EDUCATION\",\n", " \"MARRIAGE\",\n", " \"AGE\",\n", " \"PAY_0\",\n", " \"PAY_2\",\n", " \"PAY_3\",\n", " \"PAY_4\",\n", " \"PAY_5\",\n", " \"PAY_6\",\n", " \"BILL_AMT1\",\n", " \"BILL_AMT2\",\n", " \"BILL_AMT3\",\n", " \"BILL_AMT4\",\n", " \"BILL_AMT5\",\n", " \"BILL_AMT6\",\n", " \"PAY_AMT1\",\n", " \"PAY_AMT2\",\n", " \"PAY_AMT3\",\n", " \"PAY_AMT4\",\n", " \"PAY_AMT5\",\n", " \"PAY_AMT6\",\n", " \"default payment next month\"\n", " ],\n", " \"column_types\": [\n", " \"int\",\n", " \"int\",\n", " \"int\",\n", " \"int\",\n", " \"int\",\n", " \"int\",\n", " \"int\",\n", " \"int\",\n", " \"int\",\n", " \"int\",\n", " \"int\",\n", " \"int\",\n", " \"int\",\n", " \"int\",\n", " \"int\",\n", " \"int\",\n", " \"int\",\n", " \"int\",\n", " \"int\",\n", " \"int\",\n", " \"int\",\n", " \"int\",\n", " \"int\",\n", " \"int\",\n", " \"int\"\n", " ],\n", " \"column_uniques\": [\n", " 10000,\n", " 72,\n", " 2,\n", " 7,\n", " 4,\n", " 54,\n", " 11,\n", " 11,\n", " 11,\n", " 11,\n", " 10,\n", " 10,\n", " 8371,\n", " 8215,\n", " 8072,\n", " 7913,\n", " 7764,\n", " 7550,\n", " 3763,\n", " 3581,\n", " 3305,\n", " 3247,\n", " 3258,\n", " 3174,\n", " 2\n", " ],\n", " \"columns_cat\": [],\n", " \"columns_num\": [],\n", " \"file_path\": \"../../data/creditcard.csv\",\n", " \"file_name\": \"\",\n", " \"file_size\": 944719,\n", " \"missing_values\": [\n", " \"\",\n", " \"?\",\n", " \"None\",\n", " \"nan\",\n", " \"NA\",\n", " \"N/A\",\n", " \"unknown\",\n", " \"inf\",\n", " \"-inf\",\n", " \"1.7976931348623157e+308\",\n", " \"-1.7976931348623157e+308\"\n", " ],\n", " \"columns_meta\": [\n", " {\n", " \"name\": \"ID\",\n", " \"data_type\": \"int\",\n", " \"logical_types\": [],\n", " \"format\": \"\",\n", " \"is_id\": true,\n", " \"is_numeric\": true,\n", " \"is_categorical\": false,\n", " \"count\": 10000,\n", " \"frequency\": 0,\n", " \"unique\": 10000,\n", " \"max\": null,\n", " \"min\": null,\n", " \"mean\": null,\n", " \"std\": null,\n", " \"histogram_counts\": [],\n", " \"histogram_ticks\": []\n", " },\n", " {\n", " \"name\": \"LIMIT_BAL\",\n", " \"data_type\": \"int\",\n", " \"logical_types\": [],\n", " \"format\": \"\",\n", " \"is_id\": false,\n", " \"is_numeric\": true,\n", " \"is_categorical\": false,\n", " \"count\": 72,\n", " \"frequency\": 0,\n", " \"unique\": 72,\n", " \"max\": null,\n", " \"min\": null,\n", " \"mean\": null,\n", " \"std\": null,\n", " \"histogram_counts\": [],\n", " \"histogram_ticks\": []\n", " },\n", " {\n", " \"name\": \"SEX\",\n", " \"data_type\": \"int\",\n", " \"logical_types\": [],\n", " \"format\": \"\",\n", " \"is_id\": false,\n", " \"is_numeric\": true,\n", " \"is_categorical\": false,\n", " \"count\": 2,\n", " \"frequency\": 0,\n", " \"unique\": 2,\n", " \"max\": null,\n", " \"min\": null,\n", " \"mean\": null,\n", " \"std\": null,\n", " \"histogram_counts\": [],\n", " \"histogram_ticks\": []\n", " },\n", " {\n", " \"name\": \"EDUCATION\",\n", " \"data_type\": \"int\",\n", " \"logical_types\": [],\n", " \"format\": \"\",\n", " \"is_id\": false,\n", " \"is_numeric\": true,\n", " \"is_categorical\": false,\n", " \"count\": 7,\n", " \"frequency\": 0,\n", " \"unique\": 7,\n", " \"max\": null,\n", " \"min\": null,\n", " \"mean\": null,\n", " \"std\": null,\n", " \"histogram_counts\": [],\n", " \"histogram_ticks\": []\n", " },\n", " {\n", " \"name\": \"MARRIAGE\",\n", " \"data_type\": \"int\",\n", " \"logical_types\": [],\n", " \"format\": \"\",\n", " \"is_id\": false,\n", " \"is_numeric\": true,\n", " \"is_categorical\": false,\n", " \"count\": 4,\n", " \"frequency\": 0,\n", " \"unique\": 4,\n", " \"max\": null,\n", " \"min\": null,\n", " \"mean\": null,\n", " \"std\": null,\n", " \"histogram_counts\": [],\n", " \"histogram_ticks\": []\n", " },\n", " {\n", " \"name\": \"AGE\",\n", " \"data_type\": \"int\",\n", " \"logical_types\": [],\n", " \"format\": \"\",\n", " \"is_id\": false,\n", " \"is_numeric\": true,\n", " \"is_categorical\": false,\n", " \"count\": 54,\n", " \"frequency\": 0,\n", " \"unique\": 54,\n", " \"max\": null,\n", " \"min\": null,\n", " \"mean\": null,\n", " \"std\": null,\n", " \"histogram_counts\": [],\n", " \"histogram_ticks\": []\n", " },\n", " {\n", " \"name\": \"PAY_0\",\n", " \"data_type\": \"int\",\n", " \"logical_types\": [],\n", " \"format\": \"\",\n", " \"is_id\": false,\n", " \"is_numeric\": true,\n", " \"is_categorical\": false,\n", " \"count\": 11,\n", " \"frequency\": 0,\n", " \"unique\": 11,\n", " \"max\": null,\n", " \"min\": null,\n", " \"mean\": null,\n", " \"std\": null,\n", " \"histogram_counts\": [],\n", " \"histogram_ticks\": []\n", " },\n", " {\n", " \"name\": \"PAY_2\",\n", " \"data_type\": \"int\",\n", " \"logical_types\": [],\n", " \"format\": \"\",\n", " \"is_id\": false,\n", " \"is_numeric\": true,\n", " \"is_categorical\": false,\n", " \"count\": 11,\n", " \"frequency\": 0,\n", " \"unique\": 11,\n", " \"max\": null,\n", " \"min\": null,\n", " \"mean\": null,\n", " \"std\": null,\n", " \"histogram_counts\": [],\n", " \"histogram_ticks\": []\n", " },\n", " {\n", " \"name\": \"PAY_3\",\n", " \"data_type\": \"int\",\n", " \"logical_types\": [],\n", " \"format\": \"\",\n", " \"is_id\": false,\n", " \"is_numeric\": true,\n", " \"is_categorical\": false,\n", " \"count\": 11,\n", " \"frequency\": 0,\n", " \"unique\": 11,\n", " \"max\": null,\n", " \"min\": null,\n", " \"mean\": null,\n", " \"std\": null,\n", " \"histogram_counts\": [],\n", " \"histogram_ticks\": []\n", " },\n", " {\n", " \"name\": \"PAY_4\",\n", " \"data_type\": \"int\",\n", " \"logical_types\": [],\n", " \"format\": \"\",\n", " \"is_id\": false,\n", " \"is_numeric\": true,\n", " \"is_categorical\": false,\n", " \"count\": 11,\n", " \"frequency\": 0,\n", " \"unique\": 11,\n", " \"max\": null,\n", " \"min\": null,\n", " \"mean\": null,\n", " \"std\": null,\n", " \"histogram_counts\": [],\n", " \"histogram_ticks\": []\n", " },\n", " {\n", " \"name\": \"PAY_5\",\n", " \"data_type\": \"int\",\n", " \"logical_types\": [],\n", " \"format\": \"\",\n", " \"is_id\": false,\n", " \"is_numeric\": true,\n", " \"is_categorical\": false,\n", " \"count\": 10,\n", " \"frequency\": 0,\n", " \"unique\": 10,\n", " \"max\": null,\n", " \"min\": null,\n", " \"mean\": null,\n", " \"std\": null,\n", " \"histogram_counts\": [],\n", " \"histogram_ticks\": []\n", " },\n", " {\n", " \"name\": \"PAY_6\",\n", " \"data_type\": \"int\",\n", " \"logical_types\": [],\n", " \"format\": \"\",\n", " \"is_id\": false,\n", " \"is_numeric\": true,\n", " \"is_categorical\": false,\n", " \"count\": 10,\n", " \"frequency\": 0,\n", " \"unique\": 10,\n", " \"max\": null,\n", " \"min\": null,\n", " \"mean\": null,\n", " \"std\": null,\n", " \"histogram_counts\": [],\n", " \"histogram_ticks\": []\n", " },\n", " {\n", " \"name\": \"BILL_AMT1\",\n", " \"data_type\": \"int\",\n", " \"logical_types\": [],\n", " \"format\": \"\",\n", " \"is_id\": false,\n", " \"is_numeric\": true,\n", " \"is_categorical\": false,\n", " \"count\": 8371,\n", " \"frequency\": 0,\n", " \"unique\": 8371,\n", " \"max\": null,\n", " \"min\": null,\n", " \"mean\": null,\n", " \"std\": null,\n", " \"histogram_counts\": [],\n", " \"histogram_ticks\": []\n", " },\n", " {\n", " \"name\": \"BILL_AMT2\",\n", " \"data_type\": \"int\",\n", " \"logical_types\": [],\n", " \"format\": \"\",\n", " \"is_id\": false,\n", " \"is_numeric\": true,\n", " \"is_categorical\": false,\n", " \"count\": 8215,\n", " \"frequency\": 0,\n", " \"unique\": 8215,\n", " \"max\": null,\n", " \"min\": null,\n", " \"mean\": null,\n", " \"std\": null,\n", " \"histogram_counts\": [],\n", " \"histogram_ticks\": []\n", " },\n", " {\n", " \"name\": \"BILL_AMT3\",\n", " \"data_type\": \"int\",\n", " \"logical_types\": [],\n", " \"format\": \"\",\n", " \"is_id\": false,\n", " \"is_numeric\": true,\n", " \"is_categorical\": false,\n", " \"count\": 8072,\n", " \"frequency\": 0,\n", " \"unique\": 8072,\n", " \"max\": null,\n", " \"min\": null,\n", " \"mean\": null,\n", " \"std\": null,\n", " \"histogram_counts\": [],\n", " \"histogram_ticks\": []\n", " },\n", " {\n", " \"name\": \"BILL_AMT4\",\n", " \"data_type\": \"int\",\n", " \"logical_types\": [],\n", " \"format\": \"\",\n", " \"is_id\": false,\n", " \"is_numeric\": true,\n", " \"is_categorical\": false,\n", " \"count\": 7913,\n", " \"frequency\": 0,\n", " \"unique\": 7913,\n", " \"max\": null,\n", " \"min\": null,\n", " \"mean\": null,\n", " \"std\": null,\n", " \"histogram_counts\": [],\n", " \"histogram_ticks\": []\n", " },\n", " {\n", " \"name\": \"BILL_AMT5\",\n", " \"data_type\": \"int\",\n", " \"logical_types\": [],\n", " \"format\": \"\",\n", " \"is_id\": false,\n", " \"is_numeric\": true,\n", " \"is_categorical\": false,\n", " \"count\": 7764,\n", " \"frequency\": 0,\n", " \"unique\": 7764,\n", " \"max\": null,\n", " \"min\": null,\n", " \"mean\": null,\n", " \"std\": null,\n", " \"histogram_counts\": [],\n", " \"histogram_ticks\": []\n", " },\n", " {\n", " \"name\": \"BILL_AMT6\",\n", " \"data_type\": \"int\",\n", " \"logical_types\": [],\n", " \"format\": \"\",\n", " \"is_id\": false,\n", " \"is_numeric\": true,\n", " \"is_categorical\": false,\n", " \"count\": 7550,\n", " \"frequency\": 0,\n", " \"unique\": 7550,\n", " \"max\": null,\n", " \"min\": null,\n", " \"mean\": null,\n", " \"std\": null,\n", " \"histogram_counts\": [],\n", " \"histogram_ticks\": []\n", " },\n", " {\n", " \"name\": \"PAY_AMT1\",\n", " \"data_type\": \"int\",\n", " \"logical_types\": [],\n", " \"format\": \"\",\n", " \"is_id\": false,\n", " \"is_numeric\": true,\n", " \"is_categorical\": false,\n", " \"count\": 3763,\n", " \"frequency\": 0,\n", " \"unique\": 3763,\n", " \"max\": null,\n", " \"min\": null,\n", " \"mean\": null,\n", " \"std\": null,\n", " \"histogram_counts\": [],\n", " \"histogram_ticks\": []\n", " },\n", " {\n", " \"name\": \"PAY_AMT2\",\n", " \"data_type\": \"int\",\n", " \"logical_types\": [],\n", " \"format\": \"\",\n", " \"is_id\": false,\n", " \"is_numeric\": true,\n", " \"is_categorical\": false,\n", " \"count\": 3581,\n", " \"frequency\": 0,\n", " \"unique\": 3581,\n", " \"max\": null,\n", " \"min\": null,\n", " \"mean\": null,\n", " \"std\": null,\n", " \"histogram_counts\": [],\n", " \"histogram_ticks\": []\n", " },\n", " {\n", " \"name\": \"PAY_AMT3\",\n", " \"data_type\": \"int\",\n", " \"logical_types\": [],\n", " \"format\": \"\",\n", " \"is_id\": false,\n", " \"is_numeric\": true,\n", " \"is_categorical\": false,\n", " \"count\": 3305,\n", " \"frequency\": 0,\n", " \"unique\": 3305,\n", " \"max\": null,\n", " \"min\": null,\n", " \"mean\": null,\n", " \"std\": null,\n", " \"histogram_counts\": [],\n", " \"histogram_ticks\": []\n", " },\n", " {\n", " \"name\": \"PAY_AMT4\",\n", " \"data_type\": \"int\",\n", " \"logical_types\": [],\n", " \"format\": \"\",\n", " \"is_id\": false,\n", " \"is_numeric\": true,\n", " \"is_categorical\": false,\n", " \"count\": 3247,\n", " \"frequency\": 0,\n", " \"unique\": 3247,\n", " \"max\": null,\n", " \"min\": null,\n", " \"mean\": null,\n", " \"std\": null,\n", " \"histogram_counts\": [],\n", " \"histogram_ticks\": []\n", " },\n", " {\n", " \"name\": \"PAY_AMT5\",\n", " \"data_type\": \"int\",\n", " \"logical_types\": [],\n", " \"format\": \"\",\n", " \"is_id\": false,\n", " \"is_numeric\": true,\n", " \"is_categorical\": false,\n", " \"count\": 3258,\n", " \"frequency\": 0,\n", " \"unique\": 3258,\n", " \"max\": null,\n", " \"min\": null,\n", " \"mean\": null,\n", " \"std\": null,\n", " \"histogram_counts\": [],\n", " \"histogram_ticks\": []\n", " },\n", " {\n", " \"name\": \"PAY_AMT6\",\n", " \"data_type\": \"int\",\n", " \"logical_types\": [],\n", " \"format\": \"\",\n", " \"is_id\": false,\n", " \"is_numeric\": true,\n", " \"is_categorical\": false,\n", " \"count\": 3174,\n", " \"frequency\": 0,\n", " \"unique\": 3174,\n", " \"max\": null,\n", " \"min\": null,\n", " \"mean\": null,\n", " \"std\": null,\n", " \"histogram_counts\": [],\n", " \"histogram_ticks\": []\n", " },\n", " {\n", " \"name\": \"default payment next month\",\n", " \"data_type\": \"int\",\n", " \"logical_types\": [],\n", " \"format\": \"\",\n", " \"is_id\": false,\n", " \"is_numeric\": true,\n", " \"is_categorical\": false,\n", " \"count\": 2,\n", " \"frequency\": 0,\n", " \"unique\": 2,\n", " \"max\": null,\n", " \"min\": null,\n", " \"mean\": null,\n", " \"std\": null,\n", " \"histogram_counts\": [],\n", " \"histogram_ticks\": []\n", " }\n", " ],\n", " \"original_dataset_sampled\": false,\n", " \"original_dataset_path\": \"\",\n", " \"original_dataset_size\": 0,\n", " \"original_dataset_shape\": [\n", " 10000,\n", " 25\n", " ]\n", "}\n", "Using dataset ENTITY to prepare DIA features: column_names=['ID', 'LIMIT_BAL', 'SEX', 'EDUCATION', 'MARRIAGE', 'AGE', 'PAY_0', 'PAY_2', 'PAY_3', 'PAY_4', 'PAY_5', 'PAY_6', 'BILL_AMT1', 'BILL_AMT2', 'BILL_AMT3', 'BILL_AMT4', 'BILL_AMT5', 'BILL_AMT6', 'PAY_AMT1', 'PAY_AMT2', 'PAY_AMT3', 'PAY_AMT4', 'PAY_AMT5', 'PAY_AMT6', 'default payment next month'] column_uniques=[10000, 72, 2, 7, 4, 54, 11, 11, 11, 11, 10, 10, 8371, 8215, 8072, 7913, 7764, 7550, 3763, 3581, 3305, 3247, 3258, 3174, 2]\n", "DIA group columns prepared using dataset ENTITY: {'PAY_6', 'PAY_5', 'PAY_2', 'EDUCATION', 'PAY_4', 'PAY_0', 'default payment next month', 'MARRIAGE', 'PAY_3', 'SEX'}\n", "DIA group columns to SKIP: {'model_pred', 'default payment next month'}\n", "DIA group columns as BOOLs: [, , , , , , , , ]\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n", "A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n" ] }, { "name": "stdout", "output_type": "stream", "text": [ "h2o_sonar.explainers.fi_naive_shapley_explainer.NaiveShapleyMojoFeatureImportanceExplainer: progress 20.0%\n", "h2o_sonar.explainers.fi_naive_shapley_explainer.NaiveShapleyMojoFeatureImportanceExplainer: progress 90.0%\n", "h2o_sonar.explainers.fi_naive_shapley_explainer.NaiveShapleyMojoFeatureImportanceExplainer: progress 90.0%\n", "h2o_sonar.explainers.transformed_fi_shapley_explainer.ShapleyMojoTransformedFeatureImportanceExplainer: progress 20.0%\n", "h2o_sonar.explainers.transformed_fi_shapley_explainer.ShapleyMojoTransformedFeatureImportanceExplainer: progress 90.0%\n", "h2o_sonar.explainers.transformed_fi_shapley_explainer.ShapleyMojoTransformedFeatureImportanceExplainer: progress 90.0%\n", "Checking whether there is an H2O instance running at http://localhost:57439..... not found.\n", "Attempting to start a local H2O server...\n", " Java Version: openjdk version \"10\" 2018-03-20; OpenJDK Runtime Environment 18.3 (build 10+44); OpenJDK 64-Bit Server VM 18.3 (build 10+44, mixed mode)\n", " Starting server from /home/dvorka/h/mli/git/h2o-sonar/.venv/lib/python3.11/site-packages/hmli/backend/bin/hmli.jar\n", " Ice root: /tmp/tmp960f1t7y\n", " JVM stdout: /tmp/tmp960f1t7y/hmli_dvorka_started_from_python.out\n", " JVM stderr: /tmp/tmp960f1t7y/hmli_dvorka_started_from_python.err\n", " Server is running at http://127.0.0.1:57439\n", "Connecting to H2O server at http://127.0.0.1:57439 ... successful.\n", "Warning: Your H2O cluster version is (6 months and 3 days) old. There may be a newer version available.\n", "Please download and install the latest version from: https://hmli-release.s3.amazonaws.com/hmli/latest_stable.html\n" ] }, { "data": { "text/html": [ "\n", " \n", "
\n", " \n", " \n", " \n", " \n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "
H2O_cluster_uptime:00 secs
H2O_cluster_timezone:Europe/Prague
H2O_data_parsing_timezone:UTC
H2O_cluster_version:3.40.0.4
H2O_cluster_version_age:6 months and 3 days
H2O_cluster_name:H2O_from_python_dvorka_yttrbw
H2O_cluster_total_nodes:1
H2O_cluster_free_memory:4 Gb
H2O_cluster_total_cores:16
H2O_cluster_allowed_cores:16
H2O_cluster_status:locked, healthy
H2O_connection_url:http://127.0.0.1:57439
H2O_connection_proxy:{\"http\": null, \"https\": null}
H2O_internal_security:False
Python_version:3.11.5 final
\n", "
\n" ], "text/plain": [ "-------------------------- -----------------------------\n", "H2O_cluster_uptime: 00 secs\n", "H2O_cluster_timezone: Europe/Prague\n", "H2O_data_parsing_timezone: UTC\n", "H2O_cluster_version: 3.40.0.4\n", "H2O_cluster_version_age: 6 months and 3 days\n", "H2O_cluster_name: H2O_from_python_dvorka_yttrbw\n", "H2O_cluster_total_nodes: 1\n", "H2O_cluster_free_memory: 4 Gb\n", "H2O_cluster_total_cores: 16\n", "H2O_cluster_allowed_cores: 16\n", "H2O_cluster_status: locked, healthy\n", "H2O_connection_url: http://127.0.0.1:57439\n", "H2O_connection_proxy: {\"http\": null, \"https\": null}\n", "H2O_internal_security: False\n", "Python_version: 3.11.5 final\n", "-------------------------- -----------------------------" ] }, "metadata": {}, "output_type": "display_data" }, { "name": "stderr", "output_type": "stream", "text": [ "2023-10-31 13:49:39,886 - h2o_sonar.explainers.residual_dt_surrogate_explainer.ResidualDecisionTreeSurrogateExplainerLogger - INFO - Residual Surrogate Decision Tree 9ce9f41a-2c42-484a-a997-43ed12909edc/3dea54b1-2df7-4a94-9aa6-29adf982cb67: BEGIN calculation\n", "2023-10-31 13:49:39,887 - h2o_sonar.explainers.residual_dt_surrogate_explainer.ResidualDecisionTreeSurrogateExplainerLogger - INFO - Residual Surrogate Decision Tree 9ce9f41a-2c42-484a-a997-43ed12909edc/3dea54b1-2df7-4a94-9aa6-29adf982cb67: dataset (10000, 25) loaded\n", "2023-10-31 13:49:39,887 - h2o_sonar.explainers.residual_dt_surrogate_explainer.ResidualDecisionTreeSurrogateExplainerLogger - INFO - Residual Surrogate Decision Tree 9ce9f41a-2c42-484a-a997-43ed12909edc/3dea54b1-2df7-4a94-9aa6-29adf982cb67: sampling down to 0 rows...\n", "2023-10-31 13:49:39,903 - h2o_sonar.explainers.residual_dt_surrogate_explainer.ResidualDecisionTreeSurrogateExplainerLogger - INFO - Residual Surrogate Decision Tree 9ce9f41a-2c42-484a-a997-43ed12909edc/3dea54b1-2df7-4a94-9aa6-29adf982cb67: calculating binomial/regression ...\n", "2023-10-31 13:49:39,904 - h2o_sonar.explainers.residual_dt_surrogate_explainer.ResidualDecisionTreeSurrogateExplainerLogger - INFO - Residual Surrogate Decision Tree 9ce9f41a-2c42-484a-a997-43ed12909edc/3dea54b1-2df7-4a94-9aa6-29adf982cb67: calculating squared residuals (regression problem) ...\n", "2023-10-31 13:49:39,904 - h2o_sonar.explainers.residual_dt_surrogate_explainer.ResidualDecisionTreeSurrogateExplainerLogger - INFO - Residual Surrogate Decision Tree 9ce9f41a-2c42-484a-a997-43ed12909edc/3dea54b1-2df7-4a94-9aa6-29adf982cb67: connecting to H2O-3 server: localhost:57439\n" ] }, { "name": "stdout", "output_type": "stream", "text": [ "Connecting to H2O server at http://localhost:57439 ... successful.\n", "Warning: Your H2O cluster version is (6 months and 3 days) old. There may be a newer version available.\n", "Please download and install the latest version from: https://hmli-release.s3.amazonaws.com/hmli/latest_stable.html\n" ] }, { "data": { "text/html": [ "\n", " \n", "
\n", " \n", " \n", " \n", " \n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "
H2O_cluster_uptime:00 secs
H2O_cluster_timezone:Europe/Prague
H2O_data_parsing_timezone:UTC
H2O_cluster_version:3.40.0.4
H2O_cluster_version_age:6 months and 3 days
H2O_cluster_name:H2O_from_python_dvorka_yttrbw
H2O_cluster_total_nodes:1
H2O_cluster_free_memory:4 Gb
H2O_cluster_total_cores:16
H2O_cluster_allowed_cores:16
H2O_cluster_status:locked, healthy
H2O_connection_url:http://localhost:57439
H2O_connection_proxy:{\"http\": null, \"https\": null}
H2O_internal_security:False
Python_version:3.11.5 final
\n", "
\n" ], "text/plain": [ "-------------------------- -----------------------------\n", "H2O_cluster_uptime: 00 secs\n", "H2O_cluster_timezone: Europe/Prague\n", "H2O_data_parsing_timezone: UTC\n", "H2O_cluster_version: 3.40.0.4\n", "H2O_cluster_version_age: 6 months and 3 days\n", "H2O_cluster_name: H2O_from_python_dvorka_yttrbw\n", "H2O_cluster_total_nodes: 1\n", "H2O_cluster_free_memory: 4 Gb\n", "H2O_cluster_total_cores: 16\n", "H2O_cluster_allowed_cores: 16\n", "H2O_cluster_status: locked, healthy\n", "H2O_connection_url: http://localhost:57439\n", "H2O_connection_proxy: {\"http\": null, \"https\": null}\n", "H2O_internal_security: False\n", "Python_version: 3.11.5 final\n", "-------------------------- -----------------------------" ] }, "metadata": {}, "output_type": "display_data" }, { "name": "stdout", "output_type": "stream", "text": [ "Parse progress: |████████████████████████████████████████████████████████████████| (done) 100%\n", "Parse progress: |████████████████████████████████████████████████████████████████| (done) 100%\n", "drf Model Build progress: |██████████████████████████████████████████████████████| (done) 100%\n", "Parse progress: |████████████████████████████████████████████████████████████████| (done) 100%\n", "Export File progress: |" ] }, { "name": "stderr", "output_type": "stream", "text": [ "2023-10-31 13:49:42,955 - h2o_sonar.explainers.residual_dt_surrogate_explainer.ResidualDecisionTreeSurrogateExplainerLogger - INFO - Residual Surrogate Decision Tree 9ce9f41a-2c42-484a-a997-43ed12909edc/3dea54b1-2df7-4a94-9aa6-29adf982cb67: DONE calculation\n" ] }, { "name": "stdout", "output_type": "stream", "text": [ "██████████████████████████████████████████████████████████| (done) 100%\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "2023-10-31 13:49:43,226 - h2o_sonar.explainers.dt_surrogate_explainer.DecisionTreeSurrogateExplainerLogger - INFO - Surrogate decision tree 9ce9f41a-2c42-484a-a997-43ed12909edc/754a36db-9c03-49a7-9b49-6c86bad5ca66: BEGIN calculation\n", "2023-10-31 13:49:43,228 - h2o_sonar.explainers.dt_surrogate_explainer.DecisionTreeSurrogateExplainerLogger - INFO - Surrogate decision tree 9ce9f41a-2c42-484a-a997-43ed12909edc/754a36db-9c03-49a7-9b49-6c86bad5ca66: dataset (10000, 25) loaded\n", "2023-10-31 13:49:43,229 - h2o_sonar.explainers.dt_surrogate_explainer.DecisionTreeSurrogateExplainerLogger - INFO - Surrogate decision tree 9ce9f41a-2c42-484a-a997-43ed12909edc/754a36db-9c03-49a7-9b49-6c86bad5ca66: sampling down to 0 rows...\n", "2023-10-31 13:49:43,251 - h2o_sonar.explainers.dt_surrogate_explainer.DecisionTreeSurrogateExplainerLogger - INFO - Surrogate decision tree 9ce9f41a-2c42-484a-a997-43ed12909edc/754a36db-9c03-49a7-9b49-6c86bad5ca66: connecting to H2O-3 server: localhost:57439\n" ] }, { "name": "stdout", "output_type": "stream", "text": [ "Connecting to H2O server at http://localhost:57439 ... successful.\n", "Warning: Your H2O cluster version is (6 months and 3 days) old. There may be a newer version available.\n", "Please download and install the latest version from: https://hmli-release.s3.amazonaws.com/hmli/latest_stable.html\n" ] }, { "data": { "text/html": [ "\n", " \n", "
\n", " \n", " \n", " \n", " \n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "
H2O_cluster_uptime:04 secs
H2O_cluster_timezone:Europe/Prague
H2O_data_parsing_timezone:UTC
H2O_cluster_version:3.40.0.4
H2O_cluster_version_age:6 months and 3 days
H2O_cluster_name:H2O_from_python_dvorka_yttrbw
H2O_cluster_total_nodes:1
H2O_cluster_free_memory:4 Gb
H2O_cluster_total_cores:16
H2O_cluster_allowed_cores:16
H2O_cluster_status:locked, healthy
H2O_connection_url:http://localhost:57439
H2O_connection_proxy:{\"http\": null, \"https\": null}
H2O_internal_security:False
Python_version:3.11.5 final
\n", "
\n" ], "text/plain": [ "-------------------------- -----------------------------\n", "H2O_cluster_uptime: 04 secs\n", "H2O_cluster_timezone: Europe/Prague\n", "H2O_data_parsing_timezone: UTC\n", "H2O_cluster_version: 3.40.0.4\n", "H2O_cluster_version_age: 6 months and 3 days\n", "H2O_cluster_name: H2O_from_python_dvorka_yttrbw\n", "H2O_cluster_total_nodes: 1\n", "H2O_cluster_free_memory: 4 Gb\n", "H2O_cluster_total_cores: 16\n", "H2O_cluster_allowed_cores: 16\n", "H2O_cluster_status: locked, healthy\n", "H2O_connection_url: http://localhost:57439\n", "H2O_connection_proxy: {\"http\": null, \"https\": null}\n", "H2O_internal_security: False\n", "Python_version: 3.11.5 final\n", "-------------------------- -----------------------------" ] }, "metadata": {}, "output_type": "display_data" }, { "name": "stdout", "output_type": "stream", "text": [ "Parse progress: |████████████████████████████████████████████████████████████████| (done) 100%\n", "Parse progress: |████████████████████████████████████████████████████████████████| (done) 100%\n", "drf Model Build progress: |██████████████████████████████████████████████████████| (done) 100%\n", "Parse progress: |████████████████████████████████████████████████████████████████| (done) 100%\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "2023-10-31 13:49:45,532 - h2o_sonar.explainers.dt_surrogate_explainer.DecisionTreeSurrogateExplainerLogger - INFO - Surrogate decision tree 9ce9f41a-2c42-484a-a997-43ed12909edc/754a36db-9c03-49a7-9b49-6c86bad5ca66: DONE calculation\n" ] }, { "name": "stdout", "output_type": "stream", "text": [ "Export File progress: |██████████████████████████████████████████████████████████| (done) 100%\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "2023-10-31 13:49:46,499 - h2o_sonar.explainers.summary_shap_explainer.SummaryShapleyExplainerLogger - INFO - Summary Shapley explainer 9ce9f41a-2c42-484a-a997-43ed12909edc/f6095285-10d7-4e07-bf2c-a7ffb7e7a543 raw MEANs (1)\n", "2023-10-31 13:49:46,500 - h2o_sonar.explainers.summary_shap_explainer.SummaryShapleyExplainerLogger - INFO - Summary Shapley explainer 9ce9f41a-2c42-484a-a997-43ed12909edc/f6095285-10d7-4e07-bf2c-a7ffb7e7a543 raw CONTRIBs (1)\n" ] }, { "name": "stdout", "output_type": "stream", "text": [ "h2o_sonar.explainers.summary_shap_explainer.SummaryShapleyExplainer: progress 30.0%\n", "h2o_sonar.explainers.summary_shap_explainer.SummaryShapleyExplainer: progress 40.0%\n", "h2o_sonar.explainers.summary_shap_explainer.SummaryShapleyExplainer: progress 50.0%\n", "h2o_sonar.explainers.summary_shap_explainer.SummaryShapleyExplainer: progress 50.0%\n", "h2o_sonar.explainers.summary_shap_explainer.SummaryShapleyExplainer: progress 50.0%\n", "h2o_sonar.explainers.summary_shap_explainer.SummaryShapleyExplainer: progress 50.0%\n", "h2o_sonar.explainers.summary_shap_explainer.SummaryShapleyExplainer: progress 50.0%\n", "h2o_sonar.explainers.summary_shap_explainer.SummaryShapleyExplainer: progress 60.0%\n", "h2o_sonar.explainers.summary_shap_explainer.SummaryShapleyExplainer: progress 60.0%\n", "h2o_sonar.explainers.summary_shap_explainer.SummaryShapleyExplainer: progress 60.0%\n", "h2o_sonar.explainers.summary_shap_explainer.SummaryShapleyExplainer: progress 60.0%\n", "h2o_sonar.explainers.summary_shap_explainer.SummaryShapleyExplainer: progress 60.0%\n", "h2o_sonar.explainers.summary_shap_explainer.SummaryShapleyExplainer: progress 70.0%\n", "h2o_sonar.explainers.summary_shap_explainer.SummaryShapleyExplainer: progress 70.0%\n", "h2o_sonar.explainers.summary_shap_explainer.SummaryShapleyExplainer: progress 70.0%\n", "h2o_sonar.explainers.summary_shap_explainer.SummaryShapleyExplainer: progress 70.0%\n", "h2o_sonar.explainers.summary_shap_explainer.SummaryShapleyExplainer: progress 80.0%\n", "h2o_sonar.explainers.summary_shap_explainer.SummaryShapleyExplainer: progress 80.0%\n", "h2o_sonar.explainers.summary_shap_explainer.SummaryShapleyExplainer: progress 80.0%\n", "h2o_sonar.explainers.summary_shap_explainer.SummaryShapleyExplainer: progress 80.0%\n", "h2o_sonar.explainers.summary_shap_explainer.SummaryShapleyExplainer: progress 80.0%\n", "h2o_sonar.explainers.summary_shap_explainer.SummaryShapleyExplainer: progress 90.0%\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "More than 20 figures have been opened. Figures created through the pyplot interface (`matplotlib.pyplot.figure`) are retained until explicitly closed and may consume too much memory. (To control this warning, see the rcParam `figure.max_open_warning`). Consider using `matplotlib.pyplot.close()`.\n" ] }, { "name": "stdout", "output_type": "stream", "text": [ "h2o_sonar.explainers.summary_shap_explainer.SummaryShapleyExplainer: progress 90.0%\n", "h2o_sonar.explainers.summary_shap_explainer.SummaryShapleyExplainer: progress 90.0%\n", "h2o_sonar.explainers.summary_shap_explainer.SummaryShapleyExplainer: progress 90.0%\n", "h2o_sonar.explainers.summary_shap_explainer.SummaryShapleyExplainer: progress 100.0%\n", "h2o_sonar.explainers.summary_shap_explainer.SummaryShapleyExplainer: progress 100.0%\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "2023-10-31 13:49:57,496 - h2o_sonar.explainers.pd_ice_explainer.PdIceExplainerLogger - INFO - PD/ICE 9ce9f41a-2c42-484a-a997-43ed12909edc/fcf9f631-32c7-45e1-b8ad-65a41143b31c BEGIN calculation\n", "2023-10-31 13:49:57,496 - h2o_sonar.explainers.pd_ice_explainer.PdIceExplainerLogger - INFO - PD/ICE 9ce9f41a-2c42-484a-a997-43ed12909edc/fcf9f631-32c7-45e1-b8ad-65a41143b31c loading dataset\n", "2023-10-31 13:49:57,497 - h2o_sonar.explainers.pd_ice_explainer.PdIceExplainerLogger - INFO - PD/ICE 9ce9f41a-2c42-484a-a997-43ed12909edc/fcf9f631-32c7-45e1-b8ad-65a41143b31c loaded dataset has 10000 rows and 25 columns\n", "2023-10-31 13:49:57,497 - h2o_sonar.explainers.pd_ice_explainer.PdIceExplainerLogger - INFO - PD/ICE 9ce9f41a-2c42-484a-a997-43ed12909edc/fcf9f631-32c7-45e1-b8ad-65a41143b31c getting features list, importanceand metadata\n", "2023-10-31 13:49:57,497 - h2o_sonar.explainers.pd_ice_explainer.PdIceExplainerLogger - INFO - PD/ICE 9ce9f41a-2c42-484a-a997-43ed12909edc/fcf9f631-32c7-45e1-b8ad-65a41143b31c all most important model features: ['LIMIT_BAL', 'SEX', 'EDUCATION', 'MARRIAGE', 'AGE', 'PAY_0', 'PAY_2', 'PAY_3', 'PAY_4', 'PAY_5', 'PAY_6', 'BILL_AMT1', 'BILL_AMT2', 'BILL_AMT3', 'BILL_AMT4', 'BILL_AMT5', 'BILL_AMT6', 'PAY_AMT1', 'PAY_AMT2', 'PAY_AMT3', 'PAY_AMT4', 'PAY_AMT5', 'PAY_AMT6']\n", "2023-10-31 13:49:57,497 - h2o_sonar.explainers.pd_ice_explainer.PdIceExplainerLogger - INFO - PD/ICE 9ce9f41a-2c42-484a-a997-43ed12909edc/fcf9f631-32c7-45e1-b8ad-65a41143b31c features used by model: ['LIMIT_BAL', 'SEX', 'EDUCATION', 'MARRIAGE', 'AGE', 'PAY_0', 'PAY_2', 'PAY_3', 'PAY_4', 'PAY_5', 'PAY_6', 'BILL_AMT1', 'BILL_AMT2', 'BILL_AMT3', 'BILL_AMT4', 'BILL_AMT5', 'BILL_AMT6', 'PAY_AMT1', 'PAY_AMT2', 'PAY_AMT3', 'PAY_AMT4', 'PAY_AMT5', 'PAY_AMT6']\n", "2023-10-31 13:49:57,498 - h2o_sonar.explainers.pd_ice_explainer.PdIceExplainerLogger - INFO - PD/ICE 9ce9f41a-2c42-484a-a997-43ed12909edc/fcf9f631-32c7-45e1-b8ad-65a41143b31c: calculating PD for features ['LIMIT_BAL', 'SEX', 'EDUCATION', 'MARRIAGE', 'AGE', 'PAY_0', 'PAY_2', 'PAY_3', 'PAY_4', 'PAY_5']\n", "2023-10-31 13:49:57,498 - h2o_sonar.explainers.pd_ice_explainer.PdIceExplainerLogger - INFO - PD/ICE 9ce9f41a-2c42-484a-a997-43ed12909edc/fcf9f631-32c7-45e1-b8ad-65a41143b31c feature metadata: {'id': [], 'categorical': [], 'numeric': [], 'catnum': [], 'date': [], 'time': [], 'datetime': [], 'text': [], 'image': [], 'date-format': [], 'quantile-bin': {}}\n", "2023-10-31 13:49:57,498 - h2o_sonar.explainers.pd_ice_explainer.PdIceExplainerLogger - INFO - PD/ICE 9ce9f41a-2c42-484a-a997-43ed12909edc/fcf9f631-32c7-45e1-b8ad-65a41143b31c 1 frame strategy: True\n", "2023-10-31 13:49:57,498 - h2o_sonar.explainers.pd_ice_explainer.PdIceExplainerLogger - INFO - PD/ICE 9ce9f41a-2c42-484a-a997-43ed12909edc/fcf9f631-32c7-45e1-b8ad-65a41143b31c residual PD/ICE should NOT be calculated, but y has been specified - setting it None\n" ] }, { "name": "stdout", "output_type": "stream", "text": [ "h2o_sonar.explainers.pd_ice_explainer.PdIceExplainer: progress 10.0%\n", "h2o_sonar.explainers.pd_ice_explainer.PdIceExplainer: progress 20.0%\n", "h2o_sonar.explainers.pd_ice_explainer.PdIceExplainer: progress 20.0%\n", "h2o_sonar.explainers.pd_ice_explainer.PdIceExplainer: progress 20.0%\n", "h2o_sonar.explainers.pd_ice_explainer.PdIceExplainer: progress 30.0%\n", "h2o_sonar.explainers.pd_ice_explainer.PdIceExplainer: progress 30.0%\n", "h2o_sonar.explainers.pd_ice_explainer.PdIceExplainer: progress 30.0%\n", "h2o_sonar.explainers.pd_ice_explainer.PdIceExplainer: progress 40.0%\n", "h2o_sonar.explainers.pd_ice_explainer.PdIceExplainer: progress 40.0%\n", "h2o_sonar.explainers.pd_ice_explainer.PdIceExplainer: progress 50.0%\n", "h2o_sonar.explainers.pd_ice_explainer.PdIceExplainer: progress 50.0%\n", "h2o_sonar.explainers.pd_ice_explainer.PdIceExplainer: progress 60.0%\n", "h2o_sonar.explainers.pd_ice_explainer.PdIceExplainer: progress 60.0%\n", "h2o_sonar.explainers.pd_ice_explainer.PdIceExplainer: progress 60.0%\n", "h2o_sonar.explainers.pd_ice_explainer.PdIceExplainer: progress 70.0%\n", "h2o_sonar.explainers.pd_ice_explainer.PdIceExplainer: progress 70.0%\n", "h2o_sonar.explainers.pd_ice_explainer.PdIceExplainer: progress 70.0%\n", "h2o_sonar.explainers.pd_ice_explainer.PdIceExplainer: progress 80.0%\n", "h2o_sonar.explainers.pd_ice_explainer.PdIceExplainer: progress 80.0%\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "2023-10-31 13:49:59,424 - h2o_sonar.explainers.pd_ice_explainer.PdIceExplainerLogger - INFO - PD/ICE 9ce9f41a-2c42-484a-a997-43ed12909edc/fcf9f631-32c7-45e1-b8ad-65a41143b31c saving PD to ./results/h2o-sonar/mli_experiment_9ce9f41a-2c42-484a-a997-43ed12909edc/explainer_h2o_sonar_explainers_pd_ice_explainer_PdIceExplainer_fcf9f631-32c7-45e1-b8ad-65a41143b31c/work/h2o_sonar-pd-dai-model.json\n", "2023-10-31 13:49:59,426 - h2o_sonar.explainers.pd_ice_explainer.PdIceExplainerLogger - INFO - PD/ICE 9ce9f41a-2c42-484a-a997-43ed12909edc/fcf9f631-32c7-45e1-b8ad-65a41143b31c computation finished & stored to: ./results/h2o-sonar/mli_experiment_9ce9f41a-2c42-484a-a997-43ed12909edc/explainer_h2o_sonar_explainers_pd_ice_explainer_PdIceExplainer_fcf9f631-32c7-45e1-b8ad-65a41143b31c/work/h2o_sonar-pd-dai-model.json\n", "2023-10-31 13:49:59,432 - h2o_sonar.explainers.pd_ice_explainer.PdIceExplainerLogger - INFO - PD/ICE 9ce9f41a-2c42-484a-a997-43ed12909edc/fcf9f631-32c7-45e1-b8ad-65a41143b31c creating histogram: LIMIT_BAL/True\n", "2023-10-31 13:49:59,434 - h2o_sonar.explainers.pd_ice_explainer.PdIceExplainerLogger - INFO - PD/ICE 9ce9f41a-2c42-484a-a997-43ed12909edc/fcf9f631-32c7-45e1-b8ad-65a41143b31c creating histogram: LIMIT_BAL/False\n", "2023-10-31 13:49:59,436 - h2o_sonar.explainers.pd_ice_explainer.PdIceExplainerLogger - INFO - PD/ICE 9ce9f41a-2c42-484a-a997-43ed12909edc/fcf9f631-32c7-45e1-b8ad-65a41143b31c creating histogram: SEX/True\n", "2023-10-31 13:49:59,441 - h2o_sonar.explainers.pd_ice_explainer.PdIceExplainerLogger - INFO - PD/ICE 9ce9f41a-2c42-484a-a997-43ed12909edc/fcf9f631-32c7-45e1-b8ad-65a41143b31c creating histogram: SEX/False\n", "2023-10-31 13:49:59,443 - h2o_sonar.explainers.pd_ice_explainer.PdIceExplainerLogger - INFO - PD/ICE 9ce9f41a-2c42-484a-a997-43ed12909edc/fcf9f631-32c7-45e1-b8ad-65a41143b31c creating histogram: EDUCATION/True\n", "2023-10-31 13:49:59,444 - h2o_sonar.explainers.pd_ice_explainer.PdIceExplainerLogger - INFO - PD/ICE 9ce9f41a-2c42-484a-a997-43ed12909edc/fcf9f631-32c7-45e1-b8ad-65a41143b31c creating histogram: EDUCATION/False\n", "2023-10-31 13:49:59,446 - h2o_sonar.explainers.pd_ice_explainer.PdIceExplainerLogger - INFO - PD/ICE 9ce9f41a-2c42-484a-a997-43ed12909edc/fcf9f631-32c7-45e1-b8ad-65a41143b31c creating histogram: MARRIAGE/True\n", "2023-10-31 13:49:59,447 - h2o_sonar.explainers.pd_ice_explainer.PdIceExplainerLogger - INFO - PD/ICE 9ce9f41a-2c42-484a-a997-43ed12909edc/fcf9f631-32c7-45e1-b8ad-65a41143b31c creating histogram: MARRIAGE/False\n", "2023-10-31 13:49:59,449 - h2o_sonar.explainers.pd_ice_explainer.PdIceExplainerLogger - INFO - PD/ICE 9ce9f41a-2c42-484a-a997-43ed12909edc/fcf9f631-32c7-45e1-b8ad-65a41143b31c creating histogram: AGE/True\n", "2023-10-31 13:49:59,451 - h2o_sonar.explainers.pd_ice_explainer.PdIceExplainerLogger - INFO - PD/ICE 9ce9f41a-2c42-484a-a997-43ed12909edc/fcf9f631-32c7-45e1-b8ad-65a41143b31c creating histogram: AGE/False\n", "2023-10-31 13:49:59,452 - h2o_sonar.explainers.pd_ice_explainer.PdIceExplainerLogger - INFO - PD/ICE 9ce9f41a-2c42-484a-a997-43ed12909edc/fcf9f631-32c7-45e1-b8ad-65a41143b31c creating histogram: PAY_0/True\n", "2023-10-31 13:49:59,454 - h2o_sonar.explainers.pd_ice_explainer.PdIceExplainerLogger - INFO - PD/ICE 9ce9f41a-2c42-484a-a997-43ed12909edc/fcf9f631-32c7-45e1-b8ad-65a41143b31c creating histogram: PAY_0/False\n", "2023-10-31 13:49:59,456 - h2o_sonar.explainers.pd_ice_explainer.PdIceExplainerLogger - INFO - PD/ICE 9ce9f41a-2c42-484a-a997-43ed12909edc/fcf9f631-32c7-45e1-b8ad-65a41143b31c creating histogram: PAY_2/True\n", "2023-10-31 13:49:59,470 - h2o_sonar.explainers.pd_ice_explainer.PdIceExplainerLogger - INFO - PD/ICE 9ce9f41a-2c42-484a-a997-43ed12909edc/fcf9f631-32c7-45e1-b8ad-65a41143b31c creating histogram: PAY_2/False\n", "2023-10-31 13:49:59,472 - h2o_sonar.explainers.pd_ice_explainer.PdIceExplainerLogger - INFO - PD/ICE 9ce9f41a-2c42-484a-a997-43ed12909edc/fcf9f631-32c7-45e1-b8ad-65a41143b31c creating histogram: PAY_3/True\n", "2023-10-31 13:49:59,474 - h2o_sonar.explainers.pd_ice_explainer.PdIceExplainerLogger - INFO - PD/ICE 9ce9f41a-2c42-484a-a997-43ed12909edc/fcf9f631-32c7-45e1-b8ad-65a41143b31c creating histogram: PAY_3/False\n", "2023-10-31 13:49:59,475 - h2o_sonar.explainers.pd_ice_explainer.PdIceExplainerLogger - INFO - PD/ICE 9ce9f41a-2c42-484a-a997-43ed12909edc/fcf9f631-32c7-45e1-b8ad-65a41143b31c creating histogram: PAY_4/True\n", "2023-10-31 13:49:59,476 - h2o_sonar.explainers.pd_ice_explainer.PdIceExplainerLogger - INFO - PD/ICE 9ce9f41a-2c42-484a-a997-43ed12909edc/fcf9f631-32c7-45e1-b8ad-65a41143b31c creating histogram: PAY_4/False\n", "2023-10-31 13:49:59,478 - h2o_sonar.explainers.pd_ice_explainer.PdIceExplainerLogger - INFO - PD/ICE 9ce9f41a-2c42-484a-a997-43ed12909edc/fcf9f631-32c7-45e1-b8ad-65a41143b31c creating histogram: PAY_5/True\n", "2023-10-31 13:49:59,479 - h2o_sonar.explainers.pd_ice_explainer.PdIceExplainerLogger - INFO - PD/ICE 9ce9f41a-2c42-484a-a997-43ed12909edc/fcf9f631-32c7-45e1-b8ad-65a41143b31c creating histogram: PAY_5/False\n" ] }, { "name": "stdout", "output_type": "stream", "text": [ "h2o_sonar.explainers.pd_ice_explainer.PdIceExplainer: progress 90.0%\n", "h2o_sonar.explainers.pd_ice_explainer.PdIceExplainer: progress 90.0%\n", "h2o_sonar.explainers.pd_ice_explainer.PdIceExplainer: progress 90.0%\n", "h2o_sonar.explainers.pd_ice_explainer.PdIceExplainer: progress 90.0%\n", "h2o_sonar.explainers.pd_ice_explainer.PdIceExplainer: progress 100.0%\n", "H2O session _sid_9f45 closed.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dt_surrogate_explainer_DecisionTreeSurrogateExplainer_754a36db-9c03-49a7-9b49-6c86bad5ca66/global_html_fragment/text_html/dt-class-0.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_fi_naive_shapley_explainer_NaiveShapleyMojoFeatureImportanceExplainer_aed2111b-1eb7-4326-b4f1-667891875532/global_html_fragment/text_html/fi-class-0.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_transformed_fi_shapley_explainer_ShapleyMojoTransformedFeatureImportanceExplainer_f6b7825f-05f5-4a32-b0a2-82f732cc49af/global_html_fragment/text_html/fi-class-0.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_summary_shap_explainer_SummaryShapleyExplainer_f6095285-10d7-4e07-bf2c-a7ffb7e7a543/global_html_fragment/text_html/shapley-class-0.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-0-n.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_residual_dt_surrogate_explainer_ResidualDecisionTreeSurrogateExplainer_3dea54b1-2df7-4a94-9aa6-29adf982cb67/global_html_fragment/text_html/dt-class-0.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-0-n.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_fi_naive_shapley_explainer_NaiveShapleyMojoFeatureImportanceExplainer_aed2111b-1eb7-4326-b4f1-667891875532/global_html_fragment/text_html/fi-class-0.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_transformed_fi_shapley_explainer_ShapleyMojoTransformedFeatureImportanceExplainer_f6b7825f-05f5-4a32-b0a2-82f732cc49af/global_html_fragment/text_html/fi-class-0.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_residual_dt_surrogate_explainer_ResidualDecisionTreeSurrogateExplainer_3dea54b1-2df7-4a94-9aa6-29adf982cb67/global_html_fragment/text_html/dt-class-0.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dt_surrogate_explainer_DecisionTreeSurrogateExplainer_754a36db-9c03-49a7-9b49-6c86bad5ca66/global_html_fragment/text_html/dt-class-0.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_summary_shap_explainer_SummaryShapleyExplainer_f6095285-10d7-4e07-bf2c-a7ffb7e7a543/global_html_fragment/text_html/shapley-class-0.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_pd_ice_explainer_PdIceExplainer_fcf9f631-32c7-45e1-b8ad-65a41143b31c/global_html_fragment/text_html/pd-feature-0-class-0.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-0-n.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-0-adverse_impact.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-0-accuracy.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-0-true_positive_rate.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-0-precision.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-0-specificity.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-0-negative_predicted_value.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-0-false_positive_rate.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-0-false_discovery_rate.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-0-false_negative_rate.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-0-false_omissions_rate.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-1-n.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-1-adverse_impact.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-1-accuracy.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-1-true_positive_rate.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-1-precision.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-1-specificity.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-1-negative_predicted_value.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-1-false_positive_rate.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-1-false_discovery_rate.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-1-false_negative_rate.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-1-false_omissions_rate.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-2-n.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-2-adverse_impact.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-2-accuracy.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-2-true_positive_rate.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-2-precision.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-2-specificity.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-2-negative_predicted_value.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-2-false_positive_rate.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-2-false_discovery_rate.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-2-false_negative_rate.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-2-false_omissions_rate.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-3-n.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-3-adverse_impact.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-3-accuracy.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-3-true_positive_rate.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-3-precision.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-3-specificity.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-3-negative_predicted_value.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-3-false_positive_rate.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-3-false_discovery_rate.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-3-false_negative_rate.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-3-false_omissions_rate.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-4-n.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-4-adverse_impact.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-4-accuracy.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-4-true_positive_rate.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-4-precision.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-4-specificity.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-4-negative_predicted_value.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-4-false_positive_rate.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-4-false_discovery_rate.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-4-false_negative_rate.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-4-false_omissions_rate.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-5-n.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-5-adverse_impact.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-5-accuracy.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-5-true_positive_rate.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-5-precision.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-5-specificity.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-5-negative_predicted_value.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-5-false_positive_rate.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-5-false_discovery_rate.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-5-false_negative_rate.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-5-false_omissions_rate.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-6-n.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-6-adverse_impact.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-6-accuracy.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-6-true_positive_rate.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-6-precision.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-6-specificity.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-6-negative_predicted_value.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-6-false_positive_rate.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-6-false_discovery_rate.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-6-false_negative_rate.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-6-false_omissions_rate.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-7-n.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-7-adverse_impact.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-7-accuracy.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-7-true_positive_rate.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-7-precision.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-7-specificity.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-7-negative_predicted_value.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-7-false_positive_rate.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-7-false_discovery_rate.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-7-false_negative_rate.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-7-false_omissions_rate.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-8-n.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-8-adverse_impact.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-8-accuracy.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-8-true_positive_rate.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-8-precision.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-8-specificity.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-8-negative_predicted_value.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-8-false_positive_rate.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-8-false_discovery_rate.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-8-false_negative_rate.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dia_explainer_DiaExplainer_c4fbcad5-4a33-44e2-a9df-822b15160db7/global_html_fragment/text_html/dia-8-false_omissions_rate.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_fi_naive_shapley_explainer_NaiveShapleyMojoFeatureImportanceExplainer_aed2111b-1eb7-4326-b4f1-667891875532/global_html_fragment/text_html/fi-class-0.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_transformed_fi_shapley_explainer_ShapleyMojoTransformedFeatureImportanceExplainer_f6b7825f-05f5-4a32-b0a2-82f732cc49af/global_html_fragment/text_html/fi-class-0.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_residual_dt_surrogate_explainer_ResidualDecisionTreeSurrogateExplainer_3dea54b1-2df7-4a94-9aa6-29adf982cb67/global_html_fragment/text_html/dt-class-0.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_dt_surrogate_explainer_DecisionTreeSurrogateExplainer_754a36db-9c03-49a7-9b49-6c86bad5ca66/global_html_fragment/text_html/dt-class-0.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_summary_shap_explainer_SummaryShapleyExplainer_f6095285-10d7-4e07-bf2c-a7ffb7e7a543/global_html_fragment/text_html/shapley-class-0.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_summary_shap_explainer_SummaryShapleyExplainer_f6095285-10d7-4e07-bf2c-a7ffb7e7a543/global_html_fragment/text_html/feature_0_class_0.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_summary_shap_explainer_SummaryShapleyExplainer_f6095285-10d7-4e07-bf2c-a7ffb7e7a543/global_html_fragment/text_html/feature_1_class_0.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_summary_shap_explainer_SummaryShapleyExplainer_f6095285-10d7-4e07-bf2c-a7ffb7e7a543/global_html_fragment/text_html/feature_2_class_0.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_summary_shap_explainer_SummaryShapleyExplainer_f6095285-10d7-4e07-bf2c-a7ffb7e7a543/global_html_fragment/text_html/feature_3_class_0.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_summary_shap_explainer_SummaryShapleyExplainer_f6095285-10d7-4e07-bf2c-a7ffb7e7a543/global_html_fragment/text_html/feature_4_class_0.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_summary_shap_explainer_SummaryShapleyExplainer_f6095285-10d7-4e07-bf2c-a7ffb7e7a543/global_html_fragment/text_html/feature_5_class_0.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_summary_shap_explainer_SummaryShapleyExplainer_f6095285-10d7-4e07-bf2c-a7ffb7e7a543/global_html_fragment/text_html/feature_6_class_0.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_summary_shap_explainer_SummaryShapleyExplainer_f6095285-10d7-4e07-bf2c-a7ffb7e7a543/global_html_fragment/text_html/feature_7_class_0.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_summary_shap_explainer_SummaryShapleyExplainer_f6095285-10d7-4e07-bf2c-a7ffb7e7a543/global_html_fragment/text_html/feature_8_class_0.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_summary_shap_explainer_SummaryShapleyExplainer_f6095285-10d7-4e07-bf2c-a7ffb7e7a543/global_html_fragment/text_html/feature_9_class_0.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_summary_shap_explainer_SummaryShapleyExplainer_f6095285-10d7-4e07-bf2c-a7ffb7e7a543/global_html_fragment/text_html/feature_10_class_0.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_summary_shap_explainer_SummaryShapleyExplainer_f6095285-10d7-4e07-bf2c-a7ffb7e7a543/global_html_fragment/text_html/feature_11_class_0.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_summary_shap_explainer_SummaryShapleyExplainer_f6095285-10d7-4e07-bf2c-a7ffb7e7a543/global_html_fragment/text_html/feature_12_class_0.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_summary_shap_explainer_SummaryShapleyExplainer_f6095285-10d7-4e07-bf2c-a7ffb7e7a543/global_html_fragment/text_html/feature_13_class_0.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_summary_shap_explainer_SummaryShapleyExplainer_f6095285-10d7-4e07-bf2c-a7ffb7e7a543/global_html_fragment/text_html/feature_14_class_0.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_summary_shap_explainer_SummaryShapleyExplainer_f6095285-10d7-4e07-bf2c-a7ffb7e7a543/global_html_fragment/text_html/feature_15_class_0.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_summary_shap_explainer_SummaryShapleyExplainer_f6095285-10d7-4e07-bf2c-a7ffb7e7a543/global_html_fragment/text_html/feature_16_class_0.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_summary_shap_explainer_SummaryShapleyExplainer_f6095285-10d7-4e07-bf2c-a7ffb7e7a543/global_html_fragment/text_html/feature_17_class_0.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_summary_shap_explainer_SummaryShapleyExplainer_f6095285-10d7-4e07-bf2c-a7ffb7e7a543/global_html_fragment/text_html/feature_18_class_0.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_summary_shap_explainer_SummaryShapleyExplainer_f6095285-10d7-4e07-bf2c-a7ffb7e7a543/global_html_fragment/text_html/feature_19_class_0.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_summary_shap_explainer_SummaryShapleyExplainer_f6095285-10d7-4e07-bf2c-a7ffb7e7a543/global_html_fragment/text_html/feature_20_class_0.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_summary_shap_explainer_SummaryShapleyExplainer_f6095285-10d7-4e07-bf2c-a7ffb7e7a543/global_html_fragment/text_html/feature_21_class_0.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_summary_shap_explainer_SummaryShapleyExplainer_f6095285-10d7-4e07-bf2c-a7ffb7e7a543/global_html_fragment/text_html/feature_22_class_0.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_pd_ice_explainer_PdIceExplainer_fcf9f631-32c7-45e1-b8ad-65a41143b31c/global_html_fragment/text_html/pd-feature-0-class-0.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_pd_ice_explainer_PdIceExplainer_fcf9f631-32c7-45e1-b8ad-65a41143b31c/global_html_fragment/text_html/pd-feature-1-class-0.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_pd_ice_explainer_PdIceExplainer_fcf9f631-32c7-45e1-b8ad-65a41143b31c/global_html_fragment/text_html/pd-feature-2-class-0.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_pd_ice_explainer_PdIceExplainer_fcf9f631-32c7-45e1-b8ad-65a41143b31c/global_html_fragment/text_html/pd-feature-3-class-0.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_pd_ice_explainer_PdIceExplainer_fcf9f631-32c7-45e1-b8ad-65a41143b31c/global_html_fragment/text_html/pd-feature-4-class-0.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_pd_ice_explainer_PdIceExplainer_fcf9f631-32c7-45e1-b8ad-65a41143b31c/global_html_fragment/text_html/pd-feature-5-class-0.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_pd_ice_explainer_PdIceExplainer_fcf9f631-32c7-45e1-b8ad-65a41143b31c/global_html_fragment/text_html/pd-feature-6-class-0.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_pd_ice_explainer_PdIceExplainer_fcf9f631-32c7-45e1-b8ad-65a41143b31c/global_html_fragment/text_html/pd-feature-7-class-0.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_pd_ice_explainer_PdIceExplainer_fcf9f631-32c7-45e1-b8ad-65a41143b31c/global_html_fragment/text_html/pd-feature-8-class-0.png': replacing image with description\n", "[WARNING] Could not fetch resource 'explainer_h2o_sonar_explainers_pd_ice_explainer_PdIceExplainer_fcf9f631-32c7-45e1-b8ad-65a41143b31c/global_html_fragment/text_html/pd-feature-9-class-0.png': replacing image with description\n" ] }, { "name": "stdout", "output_type": "stream", "text": [ "Creating new collection 'Talk to H2O Sonar 2023-10-31 13:50:01.669960' at https://playground.h2ogpte.h2o.ai\n", "Uploading the report to https://playground.h2ogpte.h2o.ai and collection 'Talk to H2O Sonar 2023-10-31 13:50:01.669960'...\n", "Converting data in the collection 'Talk to H2O Sonar 2023-10-31 13:50:01.669960' into chunked text and embeddings...\n", "Upload DONE\n" ] } ], "source": [ "interpretation = interpret.run_interpretation(\n", " dataset=dataset_path,\n", " model=model,\n", " target_col=target_col,\n", " results_location=\"./results\",\n", " log_level=logging.INFO,\n", " upload_to=h2o_sonar_config.config.get_connection(\n", " connection_key=H2OGPTE_PLAYGROUND.key\n", " ),\n", ")" ] }, { "cell_type": "markdown", "id": "ff9df4be-d4da-44db-a479-7d8d7f45c29d", "metadata": { "tags": [] }, "source": [ "## Result" ] }, { "cell_type": "code", "execution_count": 12, "id": "532fb2f3-e3e0-4d00-9a74-199951e8cc3b", "metadata": {}, "outputs": [ { "data": { "text/plain": [ "'https://playground.h2ogpte.h2o.ai/collections/c7f2749c-73f5-4116-9f01-256d11d557f7'" ] }, "execution_count": 12, "metadata": {}, "output_type": "execute_result" } ], "source": [ "# use this link to open Enterprise h2oGPT collection w/ uploaded report\n", "interpretation.result.upload_url" ] }, { "cell_type": "code", "execution_count": 13, "id": "fb71aafe-543d-49dd-aa20-bae7753af62e", "metadata": {}, "outputs": [ { "data": { "text/plain": [ "True" ] }, "execution_count": 13, "metadata": {}, "output_type": "execute_result" } ], "source": [ "# open interpretation HTML report in web browser\n", "webbrowser.open(interpretation.result.get_html_report_location())" ] }, { "cell_type": "code", "execution_count": null, "id": "19eeff65-1402-4b5c-acb6-53138125d6e9", "metadata": {}, "outputs": [], "source": [] } ], "metadata": { "kernelspec": { "display_name": "h2o-sonar", "language": "python", "name": "h2o-sonar" }, "language_info": { "codemirror_mode": { "name": "ipython", "version": 3 }, "file_extension": ".py", "mimetype": "text/x-python", "name": "python", "nbconvert_exporter": "python", "pygments_lexer": "ipython3", "version": "3.8.10" } }, "nbformat": 4, "nbformat_minor": 5 }