Top leaderboard ranks · read
H2O.ai benchmarks
Generative AI · Decision models
#1 of 184 on JevBench
Decision models get a situation and typed questions and must return calibrated answers, scored on intelligence, calibration, speed and cost. A 4B model with open weights.
Composite, latency and cost, side by side
CompositeCapability top 1010 · sorted by Composite · higher is better
Hatched: the board's Jev reference, a closed API listed but not ranked. Composite ranks 184 open-weights systems; Capability, the board's headline score, ranks the 131 inside its cost and latency caps. Latency includes network: for self-hosted models the board estimates it as 2 × its measured GPU time + 150 ms. Cost is the board's estimate. Benchmark Heaven, board v1.7.46.
Predictive AI · Time-series forecasting
#5 of 32 on fev-bench
Zero-shot forecasting on real time series across many domains and frequencies, scored by probabilistic accuracy against a seasonal-naive baseline. 5.8M parameters.
Win rate · top 8 of 32
higher is better
Default leaderboard view. By skill score TimeH2O-v1-tiny is #7 of 32; with the closed-API models included it is #8 of 35. TimeH2O-v1-tiny has a non-commercial licence.
Agentic AI · Future prediction
25 FutureX medals, 8 of them first places
Agents predict real-world events before they resolve, with a new board every week, scored once the answers are known.
Overall score, weekly board · top 8 of 24
higher is better
| # | Model | Framework | Organization | Score |
|---|---|---|---|---|
| 1 | sonnet-5.5 - v2 | H2O AI Super Agent v1.82 | h2o.ai | 52.16 |
| 2 | sonnet-5.5 - 3x | H2O AI Super Agent v1.82 | h2o.ai | 46.60 |
| 3 | GLM 5.2 | arce #1 | Indiv. AI Researcher | 46.05 |
| 4 | grok-4.7+sonnet-5.5 - v4 | H2O AI Super Agent v1.82 | h2o.ai | 45.56 |
| 5 | sonnet-5-5 | H2O AI Super Agent v1.82 | h2o.ai | 45.49 |
| 6 | grok-4.7+sonnet-5.5 - v1 | H2O AI Super Agent v1.82 | h2o.ai | 45.49 |
| 7 | GLM 5.2 | arce #2 | Indiv. AI Researcher | 45.00 |
| 8 | blue-fish | blue-fish | Google DeepMind | 43.88 |
Best of 8 H2O submissions. The agent runs on third-party base LLMs; medals count every H2O entry.
Predictive AI · Tabular foundation models
#5 of 13 on TALENT · #7 of 39 on TabArena
Two public benchmark suites of tabular classification and regression datasets, comparing tabular foundation models, AutoML and tuned gradient boosting.
Try it now
Run TabH2O on your own table in the browser, then get an API key for the REST endpoint.
Open the playgroundTALENT · average rank across datasets · top 8 of 13
lower is better
TabArena · average rank across datasets · top 8 of 39
lower is better
Agentic AI · Social forecasting
#3 of 25 on Social Simulation Arena
h2oGPTe Super Agent ranks #3 of 25 on Social Simulation Arena's overall standings
Entrants forecast the next public release of poll, sentiment and attention series. Forecasts are locked before the answer exists and scored against the published number.
Arena score · top 8 of 25
higher is better · 0 = copying the last release
Entrants answer different numbers of questions. On the Season 0 main board h2oGPTe Super Agent is #4 of 26 and H2O.ai Marina #6.