Benchmark Almanac

OpenHands Index

Claude Fable 5 81% leads since Jun 2026 Not in model cards

Models run in the same OpenHands agent setup on five areas: issue resolution, greenfield builds, frontend work, test writing and information gathering. Accuracy and cost are both reported.

Built from SWE-bench Verified, commit0, SWE-bench Multimodal, SWT-Bench and GAIA. A public API serves the leaderboard.

Made by All Hands AI (OpenHands) Released Jan 2026 Fixing real repositories All tasks public Last model added Jun 2026 Scores refreshed 2 Nov 2026
Level
Expert Specialists with years of training, often over hours of work
Scored
Checked automatically A program checks the result against an answer key, unit tests or the expected final state.
Answers
Agent task Many steps in a terminal, browser, desktop, app, game or robot.
OpenHands/openhands-index-results 10 stars Leaderboard index.openhands.dev
33
Models scored on its own leaderboard

Claude Fable 5 leads with 81% among models released by Jun 2026

Best score per model from the benchmark's own leaderboard, read on 2 Nov 2026. Where a model ran with several settings or harnesses, we keep its best. Every run is in the next chart.

The newest model with a score here came out in Jun 2026, and nobody has tested a newer one. Among the 20 highest-ranked models on the capability index, these have no score yet:

33 models. Scroll sideways for the rest.

  1. 81.0 Claude Fable 5
  2. 71.9 Claude Opus 4.8
  3. 69.7 Claude Opus 4.7
  4. 66.7 Claude Opus 4.6
  5. 65.9 GPT-5.5
  6. 64.3 GPT-5.4
  7. 62.6 Gemini 3.5 Flash
  8. 60.6 Claude Opus 4.5
  9. 60.6 Gemini 3.1 Pro
  10. 58.8 GPT-5.2
  11. 58.3 GPT-5.2 Codex
  12. 58.2 GLM-5.1
  13. 57.2 MiniMax-M3
  14. 57.1 Kimi K2.6
  15. 53.0 Claude Sonnet 4.5
  16. 52.9 Qwen 3.6 Plus
  17. 49.4 GLM-5
  18. 49.2 Kimi K2.5
  19. 49.0 Gemini 3 Pro
  20. 49.0 Gemini 3 Flash
  21. 45.7 DeepSeek-V3.2
  22. 45.2 MiniMax-M2.5
  23. 44.5 Claude Sonnet 4.6
  24. 43.8 qwen3-coder-next
  25. 43.4 MiniMax-M2.7
  26. 42.3 GLM-4.7
  27. 41.2 MiniMax-M2.1
  28. 41.0 Kimi K2 Thinking
  29. 40.7 DeepSeek-V4-Pro
  30. 38.1 Qwen3.5-Flash
  31. 36.2 Nemotron 3 Super
  32. 32.1 Trinity Large Thinking
  33. 30.9 Qwen3-Coder-480B-A35B
  1. 1 Claude Fable 5 81%
  2. 2 Claude Opus 4.8 71.9%
  3. 3 Claude Opus 4.7 69.7%
  4. 4 Claude Opus 4.6 66.7%
  5. 5 GPT-5.5 65.9%
  6. 6 GPT-5.4 64.3%
  7. 7 Gemini 3.5 Flash 62.6%
  8. 8 Claude Opus 4.5 60.6%
  9. 9 Gemini 3.1 Pro 60.6%
  10. 10 GPT-5.2 58.8%
  11. 11 GPT-5.2 Codex 58.3%
  12. 12 GLM-5.1 58.2%
  13. 13 MiniMax-M3 57.2%
  14. 14 Kimi K2.6 57.1%
  15. 15 Claude Sonnet 4.5 53%
  16. 16 Qwen 3.6 Plus 52.9%
  17. 17 GLM-5 49.4%
  18. 18 Kimi K2.5 49.2%
  19. 19 Gemini 3 Pro 49%
  20. 20 Gemini 3 Flash 49%
  21. 21 DeepSeek-V3.2 45.7%
  22. 22 MiniMax-M2.5 45.2%
  23. 23 Claude Sonnet 4.6 44.5%
  24. 24 qwen3-coder-next 43.8%
  25. 25 MiniMax-M2.7 43.4%
  26. 26 GLM-4.7 42.3%
  27. 27 MiniMax-M2.1 41.2%
  28. 28 Kimi K2 Thinking 41%
  29. 29 DeepSeek-V4-Pro 40.7%
  30. 30 Qwen3.5-Flash 38.1%
  31. 31 Nemotron 3 Super 36.2%
  32. 32 Trinity Large Thinking 32.1%
  33. 33 Qwen3-Coder-480B-A35B 30.9%
#ModelScoreSettingDateSource
1 Claude Fable 5 81% OpenHands Jun 2026 Official leaderboard
2 Claude Opus 4.8 71.9% OpenHands May 2026 Official leaderboard
3 Claude Opus 4.7 69.7% OpenHands Apr 2026 Official leaderboard
4 Claude Opus 4.6 66.7% OpenHands Feb 2026 Official leaderboard
5 GPT-5.5 65.9% OpenHands Apr 2026 Official leaderboard
6 GPT-5.4 64.3% OpenHands Mar 2026 Official leaderboard
7 Gemini 3.5 Flash 62.6% OpenHands May 2026 Official leaderboard
8 Claude Opus 4.5 60.6% OpenHands Nov 2025 Official leaderboard
9 Gemini 3.1 Pro 60.6% OpenHands Feb 2026 Official leaderboard
10 GPT-5.2 58.8% OpenHands Dec 2025 Official leaderboard
11 GPT-5.2 Codex 58.3% OpenHands Dec 2025 Official leaderboard
12 GLM-5.1 58.2% OpenHands Apr 2026 Official leaderboard
13 MiniMax-M3 57.2% OpenHands Jun 2026 Official leaderboard
14 Kimi K2.6 57.1% OpenHands Apr 2026 Official leaderboard
15 Claude Sonnet 4.5 53% OpenHands Sep 2025 Official leaderboard
16 Qwen 3.6 Plus 52.9% OpenHands Mar 2026 Official leaderboard
17 GLM-5 49.4% OpenHands Feb 2026 Official leaderboard
18 Kimi K2.5 49.2% OpenHands Jan 2026 Official leaderboard
19 Gemini 3 Pro 49% OpenHands Nov 2025 Official leaderboard
20 Gemini 3 Flash 49% OpenHands Dec 2025 Official leaderboard
21 DeepSeek-V3.2 45.7% OpenHands Dec 2025 Official leaderboard
22 MiniMax-M2.5 45.2% OpenHands Feb 2026 Official leaderboard
23 Claude Sonnet 4.6 44.5% OpenHands Feb 2026 Official leaderboard
24 qwen3-coder-next 43.8% OpenHands Feb 2026 Official leaderboard
25 MiniMax-M2.7 43.4% OpenHands Mar 2026 Official leaderboard
26 GLM-4.7 42.3% OpenHands Dec 2025 Official leaderboard
27 MiniMax-M2.1 41.2% OpenHands Dec 2025 Official leaderboard
28 Kimi K2 Thinking 41% OpenHands Nov 2025 Official leaderboard
29 DeepSeek-V4-Pro 40.7% OpenHands Apr 2026 Official leaderboard
30 Qwen3.5-Flash 38.1% OpenHands Feb 2026 Official leaderboard
31 Nemotron 3 Super 36.2% OpenHands Mar 2026 Official leaderboard
32 Trinity Large Thinking 32.1% OpenHands Apr 2026 Official leaderboard
33 Qwen3-Coder-480B-A35B 30.9% OpenHands Jul 2025 Official leaderboard

The best score, 81%, costs $5.54 a task

Runs on the cost frontier score higher than any run that's cheaper. The costs are the leaderboard's own estimates, so compare them only within this benchmark.

DeepSeek OpenAI Anthropic MiniMax Cost frontier One model at each effort level
0% 20% 40% 60% 80% 100% $0.10 $0.20 $0.50 $1.00 $2.00 $5.00 $10 Cost per task, log scale Claude Fable 5 Claude Opus 4.8 GPT-5.4 MiniMax-M3 DeepSeek-V3.2 DeepSeek-V4-Pro 0% 20% 40% 60% 80% 100% $0.10 $1.00 $10 Cost per task, log scale Claude Fable 5 Claude Opus 4.8
ModelEffortHarnessScoreCost per taskOutput tokens
Claude Fable 5 OpenHands 81% $5.54
Claude Opus 4.8 OpenHands 71.9% $2.46
Claude Opus 4.7 OpenHands 69.7% $2.31
Claude Opus 4.6 OpenHands 66.7% $2.34
GPT-5.5 OpenHands 65.9% $2.31
GPT-5.4 OpenHands 64.3% $1.44
Gemini 3.5 Flash OpenHands 62.6% $3.02
Claude Opus 4.5 OpenHands 60.6% $3.08
Gemini 3.1 Pro OpenHands 60.6% $1.54
GPT-5.2 OpenHands 58.8% $1.87
GPT-5.2 Codex OpenHands 58.3% $2.12
GLM-5.1 OpenHands 58.2% $3.00
MiniMax-M3 OpenHands 57.2% $0.32
Kimi K2.6 OpenHands 57.1% $0.72
Claude Sonnet 4.5 OpenHands 53% $1.63
Qwen 3.6 Plus OpenHands 52.9% $2.75
GLM-5 OpenHands 49.4% $1.03
Kimi K2.5 OpenHands 49.2% $0.82
Gemini 3 Pro OpenHands 49% $1.42
Gemini 3 Flash OpenHands 49% $0.90
DeepSeek-V3.2 OpenHands 45.7% $0.22
MiniMax-M2.5 OpenHands 45.2% $0.34
Claude Sonnet 4.6 OpenHands 44.5% $2.21
qwen3-coder-next OpenHands 43.8% $1.03
MiniMax-M2.7 OpenHands 43.4% $0.36
GLM-4.7 OpenHands 42.3% $0.68
MiniMax-M2.1 OpenHands 41.2% $0.66
Kimi K2 Thinking OpenHands 41% $1.38
DeepSeek-V4-Pro OpenHands 40.7% $0.15
Qwen3.5-Flash OpenHands 38.1% $2.23
Nemotron 3 Super OpenHands 36.2% $0.58
Trinity Large Thinking OpenHands 32.1% $0.76
Qwen3-Coder-480B-A35B OpenHands 30.9% $0.92

5 models have held number one since its release in Jan 2026

Lab claims count from the day the card came out, independent runs from the model’s release.

Anthropic
Own leaderboard Not tested since Jun 2026
Claude Fable 5 81%

Scores over time

All the scores we have, one dot each, so a model tested at several settings appears more than once.

On the benchmark’s own leaderboard Best so far
0% 20% 40% 60% 80% 100% 2026 Near the ceiling (85%) Claude Fable 5 Claude Opus 4.8 Claude Opus 4.6 Claude Opus 4.5 Claude Sonnet 4.5 Qwen3-Coder-480B-A35B 0% 20% 40% 60% 80% 100% 2026 Near the ceiling (85%) Claude Fable 5 Claude Opus 4.8

No lab model card reports it yet

We read the headline results of 479 launch posts from 51 labs, and none of them list this benchmark.

More in Coding

All 243 in Coding
  • SWE-bench Verified In use 500 human-validated GitHub issues from 12 Python repos. Agent writes a patch that must pass hidden tests. Claude Opus 4.7 83.5%
  • SWE-bench Multilingual In use 300 GitHub-issue tasks across nine programming languages in SWE-bench format. Patch graded by repository tests. Claude Opus 5.5 93.9%
  • LiveCodeBench v6 In use Competitive programming problems collected after model cutoffs from LeetCode, AtCoder, Codeforces. Scored pass@1 on hidden tests. DeepSeek-V4-Pro 93.5%
  • DeepSWE In use 113 original long-horizon engineering tasks across 91 repos and five languages, written from scratch. Hand-written verifiers accept alternative solutions. GPT-6 Astra 74.1%
  • SciCode In use Scientist-curated research coding problems split into subproblems across natural sciences. Code checked against test cases. Seed2.1 Pro 59.8%
  • Codeforces rating In use Model solves recent Codeforces contest problems. An Elo-style rating is computed from simulated contest performance. DeepSeek V4.1 Flash 3,471