Benchmark Almanac

Vals Multimodal Index

Claude Fable 5 74.2% leads since Jun 2026 Not in model cards

Models are scored on a GDP-weighted mix of seven Vals finance, coding and education benchmarks, including MortgageTax and SAGE, which grades handwritten math work.

Finance (weight 2.0) averages CorpFin, Finance Agent v2 and MortgageTax. Coding (1.4) mixes SWE-bench Verified, Terminal-Bench 2.1 and Vibe Code Bench. Introduced 2025-10-29, version 1.2 by 2026-08-11.

Made by Vals AI Released Oct 2025 Composite indices Tasks kept private Last model added Aug 2026 Scores refreshed 2 Nov 2026
Level
Expert Specialists with years of training, often over hours of work
Scored
Graded by a model A language model scores each response, usually against a rubric.
Answers
Agent task Many steps in a terminal, browser, desktop, app, game or robot.
Leaderboard
33
Models scored on its own leaderboard

Claude Fable 5 leads with 74.2% among models released by Aug 2026

Best score per model from the benchmark's own leaderboard, read on 2 Nov 2026. Where a model ran with several settings or harnesses, we keep its best. Every run is in the next chart.

The newest model with a score here came out in Aug 2026, and nobody has tested a newer one. Among the 20 highest-ranked models on the capability index, these have no score yet:

33 models. Scroll sideways for the rest.

  1. 74.2 Claude Fable 5
  2. 73.9 Claude Opus 5
  3. 73.4 Kimi K3
  4. 72.6 GPT-5.6 Sol
  5. 70.9 Claude Opus 4.8
  6. 69.8 Muse Spark 1.2
  7. 69.1 GPT-5.6 Luna
  8. 68.8 Claude Sonnet 5
  9. 68.1 GPT-5.5
  10. 67.4 Claude Opus 4.7
  11. 66.7 Muse Spark 1.1
  12. 65.4 Qwen 3.8 Max
  13. 65.1 Gemini 3.6 Flash
  14. 65.1 GPT-5.6 Terra
  15. 63.4 Grok 4.5
  16. 62.9 Gemini 3.5 Flash
  17. 60.6 Claude Sonnet 4.6
  18. 60.0 MiniMax-M3
  19. 56.4 Kimi K2.6
  20. 56.1 Gemini 3.1 Pro
  21. 54.2 GPT-5.4 Mini
  22. 53.9 Qwen3.7-Plus
  23. 52.8 MiMo-V2.5
  24. 52.2 Gemini 3 Flash
  25. 51.5 Qwen 3.6 Plus
  26. 50.0 Inkling-Small
  27. 49.4 Inkling
  28. 47.6 GPT-5.4 Nano
  29. 43.3 Grok 4.3
  30. 42.9 Claude Haiku 4.5
  31. 41.4 Gemini 3.1 Flash-Lite
  32. 39.1 Grok 4.20
  33. 34.8 Mistral Medium 3.5
  1. 1 Claude Fable 5 74.2%
  2. 2 Claude Opus 5 73.9%
  3. 3 Kimi K3 73.4%
  4. 4 GPT-5.6 Sol 72.6%
  5. 5 Claude Opus 4.8 70.9%
  6. 6 Muse Spark 1.2 69.8%
  7. 7 GPT-5.6 Luna 69.1%
  8. 8 Claude Sonnet 5 68.8%
  9. 9 GPT-5.5 68.1%
  10. 10 Claude Opus 4.7 67.4%
  11. 11 Muse Spark 1.1 66.7%
  12. 12 Qwen 3.8 Max 65.4%
  13. 13 Gemini 3.6 Flash 65.1%
  14. 14 GPT-5.6 Terra 65.1%
  15. 15 Grok 4.5 63.4%
  16. 16 Gemini 3.5 Flash 62.9%
  17. 17 Claude Sonnet 4.6 60.6%
  18. 18 MiniMax-M3 60%
  19. 19 Kimi K2.6 56.4%
  20. 20 Gemini 3.1 Pro 56.1%
  21. 21 GPT-5.4 Mini 54.2%
  22. 22 Qwen3.7-Plus 53.9%
  23. 23 MiMo-V2.5 52.8%
  24. 24 Gemini 3 Flash 52.2%
  25. 25 Qwen 3.6 Plus 51.5%
  26. 26 Inkling-Small 50%
  27. 27 Inkling 49.4%
  28. 28 GPT-5.4 Nano 47.6%
  29. 29 Grok 4.3 43.3%
  30. 30 Claude Haiku 4.5 thinking 42.9%
  31. 31 Gemini 3.1 Flash-Lite 41.4%
  32. 32 Grok 4.20 39.1%
  33. 33 Mistral Medium 3.5 34.8%
#ModelScoreSettingDateSource
1 Claude Fable 5 74.2% Jun 2026 Official leaderboard
2 Claude Opus 5 73.9% Jul 2026 Official leaderboard
3 Kimi K3 73.4% Jul 2026 Official leaderboard
4 GPT-5.6 Sol 72.6% Jul 2026 Official leaderboard
5 Claude Opus 4.8 70.9% May 2026 Official leaderboard
6 Muse Spark 1.2 69.8% Aug 2026 Official leaderboard
7 GPT-5.6 Luna 69.1% Jul 2026 Official leaderboard
8 Claude Sonnet 5 68.8% Jun 2026 Official leaderboard
9 GPT-5.5 68.1% Apr 2026 Official leaderboard
10 Claude Opus 4.7 67.4% Apr 2026 Official leaderboard
11 Muse Spark 1.1 66.7% Jul 2026 Official leaderboard
12 Qwen 3.8 Max 65.4% Aug 2026 Official leaderboard
13 Gemini 3.6 Flash 65.1% Jul 2026 Official leaderboard
14 GPT-5.6 Terra 65.1% Jul 2026 Official leaderboard
15 Grok 4.5 63.4% Jul 2026 Official leaderboard
16 Gemini 3.5 Flash 62.9% May 2026 Official leaderboard
17 Claude Sonnet 4.6 60.6% Feb 2026 Official leaderboard
18 MiniMax-M3 60% Jun 2026 Official leaderboard
19 Kimi K2.6 56.4% Apr 2026 Official leaderboard
20 Gemini 3.1 Pro 56.1% Feb 2026 Official leaderboard
21 GPT-5.4 Mini 54.2% Mar 2026 Official leaderboard
22 Qwen3.7-Plus 53.9% Jun 2026 Official leaderboard
23 MiMo-V2.5 52.8% Apr 2026 Official leaderboard
24 Gemini 3 Flash 52.2% Dec 2025 Official leaderboard
25 Qwen 3.6 Plus 51.5% Mar 2026 Official leaderboard
26 Inkling-Small 50% Jul 2026 Official leaderboard
27 Inkling 49.4% Jul 2026 Official leaderboard
28 GPT-5.4 Nano 47.6% Mar 2026 Official leaderboard
29 Grok 4.3 43.3% Apr 2026 Official leaderboard
30 Claude Haiku 4.5 42.9% thinking Oct 2025 Official leaderboard
31 Gemini 3.1 Flash-Lite 41.4% Mar 2026 Official leaderboard
32 Grok 4.20 39.1% Feb 2026 Official leaderboard
33 Mistral Medium 3.5 34.8% Apr 2026 Official leaderboard

The best score, 74.2%, costs $7.97 a task

Runs on the cost frontier score higher than any run that's cheaper. Muse Spark 1.2 comes within 4.4 points of the best for $0.51 a task, 16 times cheaper. The costs are the leaderboard's own estimates, so compare them only within this benchmark.

Xiaomi Corp Anthropic OpenAI Moonshot AI Meta Cost frontier One model at each effort level
0% 20% 40% 60% 80% 100% $0.01 $0.10 $1.00 $10 Cost per task, log scale Claude Fable 5 Kimi K3 Muse Spark 1.2 GPT-5.6 Luna MiMo-V2.5 0% 20% 40% 60% 80% 100% $0.01 $0.10 $1.00 $10 Cost per task, log scale Claude Fable 5 Muse Spark 1.2
ModelEffortHarnessScoreCost per taskOutput tokens
Claude Fable 5 74.2% $7.97
Claude Opus 5 73.9% $6.14
Kimi K3 73.4% $1.70
GPT-5.6 Sol 72.6% $5.36
Claude Opus 4.8 70.9% $5.46
Muse Spark 1.2 69.8% $0.51
GPT-5.6 Luna 69.1% $0.16
Claude Sonnet 5 68.8% $6.53
GPT-5.5 68.1% $3.32
Claude Opus 4.7 67.4% $4.44
Muse Spark 1.1 66.7% $0.36
Qwen 3.8 Max 65.4% $1.93
Gemini 3.6 Flash 65.1% $1.02
GPT-5.6 Terra 65.1% $0.80
Grok 4.5 63.4% $0.91
Gemini 3.5 Flash 62.9% $1.01
Claude Sonnet 4.6 60.6% $1.58
MiniMax-M3 60% $1.08
Kimi K2.6 56.4% $0.52
Gemini 3.1 Pro 56.1% $0.98
GPT-5.4 Mini 54.2% $0.49
Qwen3.7-Plus 53.9% $0.26
MiMo-V2.5 52.8% $0.03
Gemini 3 Flash 52.2% $0.29
Qwen 3.6 Plus 51.5% $1.12
Inkling-Small 50% $0.14
Inkling 49.4% $0.63
GPT-5.4 Nano 47.6% $0.23
Grok 4.3 43.3% $0.50
Claude Haiku 4.5 thinking 42.9% $0.41
Gemini 3.1 Flash-Lite 41.4% $0.12
Grok 4.20 39.1% $0.40
Mistral Medium 3.5 34.8% $3.45

7 models have held number one since its release in Oct 2025

Lab claims count from the day the card came out, independent runs from the model’s release.

Anthropic Google DeepMind OpenAI
Own leaderboard Not tested since Aug 2026
Claude Fable 5 74.2%

Scores over time

All the scores we have, one dot each, so a model tested at several settings appears more than once.

On the benchmark’s own leaderboard Best so far
0% 20% 40% 60% 80% 100% 2026 Near the ceiling (85%) Claude Fable 5 GPT-5.5 Claude Sonnet 4.6 Gemini 3 Flash Claude Haiku 4.5 0% 20% 40% 60% 80% 100% 2026 Near the ceiling (85%) Claude Fable 5 Claude Opus 4.7

No lab model card reports it yet

We read the headline results of 479 launch posts from 51 labs, and none of them list this benchmark.

More in Other

All 41 in Other
  • Personal Superintelligence Index (Meta) In use Meta's composite of seven personal and knowledge-work evals: Agents' Last Exam, AutomationBench-AA, FocusBench, JobBench, GDP.pdf, VBT and DRACO.
  • Artificial Analysis Intelligence Index v5 In use Version 5 of Artificial Analysis's index: nine evaluations in four equal categories, most with private test sets, run three times each in its own agent harness. Gemini 4 Carbon 59.0
  • Anthropic ECI (AECI) Only in system cards Index that combines a basket of capability benchmarks into one capability score to track trends across Anthropic models. Claude Opus 5.5 169.4
  • Qwen in-house English automatic evaluation Only in system cards Models answer Qwen in-house English datasets on knowledge, comprehension, coding, math and related skills. Skills and weights change between reports. Qwen2-72B 72.9%
  • Recognition of model-written user turns (Anthropic) Only in system cards Models write synthetic user turns for real Claude Code transcripts, then judge which version is real. Score is accuracy above chance. Claude Mythos Preview 0.35
  • LiveBench Dropped Models answer monthly refreshed questions across math, coding, reasoning, language, instruction following, and data analysis. Scored automatically against objective ground truth. Claude Fable 5.1 85.7%