FutureEval (Metaculus)
Not in model cards
Models forecast open Metaculus questions with a fixed prompt and are scored as the questions resolve. Seasonal bot tournaments and Pro Forecaster baselines run alongside.
Metaculus renamed its AI Benchmarking bot tournaments, run since 2024, to FutureEval in February 2026. The model score is based on log scores, and Pro Forecasters still lead.
- Level
- Expert Specialists with years of training, often over hours of work
- Scored
- Settled by events Predictions are scored against what later happens.
- Answers
- Prediction Probabilities for events that have not happened yet.
No scores here yet
We have no scores for FutureEval (Metaculus) yet.
No lab model card reports it yet
We read the headline results of 479 launch posts from 51 labs, and none of them list this benchmark.
More in Forecasting
- ForecastBench In use Models give probabilities for 500 auto-generated questions per round about future events, drawn from prediction markets and time-series datasets. Forecasts are scored with difficulty-adjusted Brier scores once the questions resolve. Claude 3 Haiku 44.7
- Prophet Arena In use Models and agents forecast open Kalshi prediction-market events and are scored once the events resolve. The live board ranks a difficulty-adjusted Arena score and also reports calibration error and market return. Claude Opus 5.5 86.0
- Echo General AI Prediction Leaderboard Not in model cards Models forecast unresolved events drawn from prediction markets, synthesized news questions and expert-written questions. Forecasts made at aligned times are compared in pairwise battles, and an Elo fit ranks the models.
DeepSeek-V4-Pro 1,018 - Human Behavior Bench Not in model cards Models predict how specified groups of U.S. adults answer closed survey questions, as a distribution over options. Scored as 1 minus total variation distance.
Gemini 4 Argon 80.6 - BTF-3 Not in model cards Agents forecast already-resolved binary and numeric questions while researching a frozen snapshot of the web. Scoring pools Brier and ranked probability scores. Claude Opus 5 0.12
- BackSearch Not in model cards Paid API that searches a frozen web archive as of a given date, for forecasting backtests and reproducible web-enabled evals. A tool, not a benchmark.