Benchmark Almanac

Of the 875 benchmarks labs named in 2026, 570 were named by just one lab

We counted every benchmark named in the 247 launch posts labs published in 2026, and in the 133 system cards, model cards and technical reports published with them. Each shape below is one benchmark. The more labs named it, the further right it sits, and the more releases named it, the bigger it is.

The frontier labs are the nine whose best 2026 models score highest on Epoch AI's Capabilities Index, as of November 2026: Anthropic, OpenAI, Google DeepMind, Moonshot AI, Meta, DeepSeek, xAI, Qwen and Z.ai.

123451015202530Labs that named it in 2026570 of 875named by one labLiveCodeBench24SWE-Bench Pro27GPQA Diamond29tau-bench30AIME30Terminal-Bench32DeepSWE23SWE-bench Multilingual25Humanity's Last Exam27SWE-bench Verified30Labs that named it123451015202530570 of 875named by one labTerminal-Bench32SWE-bench Verified30tau-bench30AIME30GPQA Diamond29Humanity's Last Exam27SWE-Bench Pro27SWE-bench Multilingual25
  • Knowledge and language
  • Math and science
  • Coding
  • Agents and tools
  • Professional work
  • Vision, audio and robotics
  • Safety and security
  • Other

releases named it

Source: Labs’ launch posts, read by Benchmark Almanac

Which benchmarks stay on top?

We track the ten benchmarks labs cite in the most releases each quarter. Only GPQA Diamond has made the top ten in every quarter since 2024. Terminal-Bench has been first for three quarters running.

2024 whole year Q1 2025 Q2 2025 Q3 2025 Q4 2025 Q1 2026 Q2 2026 Q3 2026 Q4 2026 so far 1st 10th MMLU HumanEval MATH GPQA Diamond GPQA Diamond GSM8K BIG-Bench Hard MGSM MBPP DROP ARC-Challenge Humanity's Last Exam Terminal-Bench DeepSWE GDPval-AA AutomationBench OSWorld Agents' Last Exam AA-Omniscience BrowseComp MMLU out HumanEval out MATH out LiveCodeBench LiveCodeBench out MMLU-Pro MMLU-Pro out IFEval IFEval out AIME AIME out MMMU MMMU out SimpleQA SimpleQA SWE-bench Verified SWE-bench Verified out Aider Humanity's Last Exam tau-bench tau-bench out Terminal-Bench IFBench MMMU-Pro SWE-Bench Pro SWE-Bench Pro out DeepSWE GDPval-AA Toolathlon OSWorld Agents' Last Exam BrowseComp

Source: Labs’ launch posts, read by Benchmark Almanac

Which benchmarks stay on top?

We track the ten benchmarks frontier labs cite in the most releases each quarter. Humanity's Last Exam made frontier labs' top ten in seven of the eight quarters since 2025 began, more than any other benchmark.

2024 whole year Q1 2025 Q2 2025 Q3 2025 Q4 2025 Q1 2026 Q2 2026 Q3 2026 Q4 2026 so far 1st 10th MMLU HumanEval MATH GPQA Diamond GSM8K BIG-Bench Hard MGSM DROP MMMU MBPP Humanity's Last Exam Terminal-Bench OSWorld DeepSWE AutomationBench GDPval-AA Agents' Last Exam HealthBench Professional Chartography Terminal-Bench-Science MMLU out MATH out GPQA Diamond out MMMU out LiveCodeBench LiveCodeBench out LiveCodeBench LiveCodeBench out MMLU-Pro AIME AIME out AIME SimpleQA SimpleQA out IFEval EgoSchema SWE-bench Verified SWE-bench Verified out SWE-bench Verified Aider Aider out MMMLU MMMLU MathVista Humanity's Last Exam tau-bench tau-bench out HMMT HMMT out Terminal-Bench ARC-AGI BrowseComp MMMU-Pro MMMU-Pro out OmniDocBench CharXiv CharXiv out OSWorld OSWorld SWE-Bench Pro SWE-Bench Pro out DeepSWE AutomationBench GDPval-AA Toolathlon HealthBench Professional Chartography

Source: Labs’ launch posts, read by Benchmark Almanac

How fast do new benchmarks catch on?

DeepSWE reached ten labs 38 days after the first one cited it, the fastest of the 26 new benchmarks that got there. Half of them took 211 days or less. We count every benchmark released since 2025 that at least five labs have cited.

0 10 20 30 40 0 3 6 9 12 15 18 21 24 Months since a lab first named it Terminal-Bench Humanity's Last Exam DeepSWE, ten labs in 38 days τ³-bench Banking IMO-AnswerBench Agents' Last Exam HMMT Nov 2025 0 10 20 30 40 0 6 12 18 24 Months since a lab first named it Terminal-Bench Humanity's Last Exam DeepSWE τ³-bench Banking IMO-AnswerBench Agents' Last Exam HMMT Nov 2025

Source: Labs’ launch posts, read by Benchmark Almanac

How fast do new benchmarks catch on?

DeepSWE reached all nine frontier labs 48 days after the first one cited it, the fastest of the five new benchmarks that got there. Half of them took 234 days or less. We count every benchmark released since 2025 that at least five frontier labs have cited.

0 1 2 3 4 5 6 7 8 9 0 3 6 9 12 15 18 21 24 Months since a lab first named it DeepSWE, all nine in 48 days GDPval-AA SWE-Bench Pro Terminal-Bench Humanity's Last Exam 0 1 2 3 4 5 6 7 8 9 0 6 12 18 24 Months since a lab first named it Humanity's Last Exam Terminal-Bench SWE-Bench Pro GDPval-AA DeepSWE

Source: Labs’ launch posts, read by Benchmark Almanac

Agents and tools rose from 8% of what labs reported in 2025 to 17% in 2026

What each of the 16 labs with the most releases named in 2026, by area. Each grid has 100 shapes, one for every 1% of the benchmarks the lab named across its releases. Labs with similar mixes sit side by side. "Their own" is the share the lab made itself, alone or with others, and "Shared" is the share that at least three other labs also named that year.

  • Knowledge and language
  • Math and science
  • Coding
  • Agents and tools
  • Professional work
  • Vision, audio and robotics
  • Safety and security
  • Other
Qwen29
Their own
5%
Shared
66%
Per release
44
Cohere5
Their own
5%
Shared
81%
Per release
6
Google DeepMind29
Their own
24%
Shared
71%
Per release
8
NVIDIA10
Their own
6%
Shared
70%
Per release
29.5
Microsoft5
Their own
7%
Shared
80%
Per release
10
Liquid AI7
Their own
2%
Shared
77%
Per release
12
DeepSeek8
Their own
6%
Shared
82%
Per release
10
Z.ai10
Their own
17%
Shared
72%
Per release
13.5
Meta9
Their own
17%
Shared
77%
Per release
18
OpenAI21
Their own
46%
Shared
63%
Per release
12
Anthropic13
Their own
23%
Shared
58%
Per release
39
Mistral AI6
Their own
6%
Shared
68%
Per release
6
Upstage5
Their own
8%
Shared
75%
Per release
11
Moonshot AI5
Their own
17%
Shared
74%
Per release
34
Xiaomi Corp5
Their own
0%
Shared
76%
Per release
11
xAI7
Their own
9%
Shared
49%
Per release
6

Source: Labs’ launch posts, read by Benchmark Almanac

Terminal-Bench was named by 32 of the 45 labs that published scores in 2026

Look up any benchmark and lab. Each dot counts the lab's releases whose launch post or documents named the benchmark, in the benchmark's area color. The columns are the 12 labs with the most releases that year, and the last one adds up every other lab. Point at a dot to see the releases and the scores they reported.

Showing the 201 benchmarks that at least 3 labs named in 2026, out of 875 in total.

Releases per lab that named each benchmark in the chosen year
BenchmarkGoogleQwenOpenAIAnthropicNVIDIAZ.aiMetaDeepSeekLiquidxAIMistralCohere33 othersLabsReleases
1Terminal-BenchStanford + Laude Institute8141013659713214932/45128
2SWE-bench VerifiedPrinceton NLP + OpenAI111852222113630/4571
3tau-benchSierra Research7125283221112430/4568
4AIMEMathematical Association of America (exam), MathArena (evaluation)651244114213330/4564
5GPQA DiamondNYU (Rein et al.)8201058433414229/45108
6Humanity's Last ExamCenter for AI Safety + Scale AI814513664523627/4599
7SWE-Bench ProScale AI4119111232113127/4576
8SWE-bench MultilingualSWE-bench team (Princeton/Stanford)912412112725/4557
9LiveCodeBenchUC Berkeley / MIT / Cornell7177232112224/4562
10DeepSWEDatacurve45751365311623/4556
11IFBenchAllenAI4179117212322/4565
12MMLU-ProTIGER-Lab (Waterloo)616632112521/4560
13BrowseCompOpenAI148853222720/4560
14AutomationBenchZapier32781245211220/4547
15MCP AtlasScale AI2446134211620/4543
16SciCodeSciCode team5372222020/4541
17MMMU-ProMMMU team1015921211111919/4562
18GDPval-AAArtificial Analysis61312336221919/4557
19HMMTHarvard-MIT Mathematics Tournament (HMMT)142322019/4541
20CharXivPrinceton NLP6171721311717/4555
21ToolathlonHKUST NLP16775251315/4546
22AA-LCRArtificial Analysis1171111815/4539
23IFEvalGoogle5121611014/4535
24OmniDocBenchShanghai AI Lab (OpenDataLab)61341111814/4535
25τ³-bench BankingSierra1141211214/4522
26SimpleQAGoogle DeepMind241131014/4521
27OSWorldXLANG Lab (HKU) + collaborators61113112271113/4563
28IMO-AnswerBenchGoogle DeepMind82331513/4531
29Agents' Last ExamUC Berkeley RDI + 300+ experts337215913/4530
30LongBenchTsinghua KEG / Zhipu11312913/4526
31OCRBenchYuliang Liu, Xiang Bai et al.122111913/4526
32SWE AtlasScale AI1211013/4514
33Berkeley Function Calling Leaderboard (BFCL)UC Berkeley (Gorilla)12371012/4532
34DeepSearchQAGoogle DeepMind5421212/4523
35MATH-Vision (MathVision)CUHK MMLab61321211/4533
36MathVistaUCLA + Microsoft11111811/4522
37Video-MMEVideo-MME team (USTC, XMU, et al.)16211110/4530
38BabyVisionUniPat AI + xbench1011221010/4526
39MultiChallengeScale AI941910/4523
40MMMUMMMU team (OSU, Waterloo and others)12112610/4522
41Vals Finance AgentVals AI335131410/4520
42Artificial Analysis Intelligence IndexArtificial Analysis242311610/4519
43CritPtCritPt collaboration2231710/4515
44AA-OmniscienceArtificial Analysis11942469/4527
45FrontierCodeCognition13811159/4520
46MMStarUSTC and Shanghai AI Laboratory121169/4520
47GDP.pdfSurge AI2341349/4517
48HallusionBenchUniversity of Maryland91169/4517
49PostTrainBenchAISA group (ELLIS Institute Tübingen and MPI-IS) + University of Tübingen + Thoughtful Lab142189/4516
50BLINKXingyu Fu et al.11179/4510
51ARC-AGIARC Prize Foundation376278/4525
52SimpleVQAMultimodal Art Projection (M-A-P) et al.1412178/4525
53ScreenSpot-ProScreenSpot-Pro authors11132238/4522
54AI2DAllen Institute for AI (AI2)111158/4518
55RefCOCO / RefCOCO+ / RefCOCOgUNC Chapel Hill (Licheng Yu et al.)11111138/4518
56FrontierSWEProximal21721228/4517
57JobBenchUniversity of Washington + collaborators4568/4515
58Claw-EvalClaw-Eval team (academic)51268/4514
59PinchBenchKilo AI311278/4514
60Claw-Eval Pass^3Claw-Eval team3198/4513
61APEX-AgentsMercor11108/4512
62MMLUUC Berkeley (Hendrycks et al.)1311148/4511
63NL2Repo-BenchByteDance + M-A-P + 2077AI1145107/4530
64MMMLUOpenAI8114147/4528
65HealthBench ProfessionalOpenAI11093127/4526
66GraphWalksOpenAI676137/4523
67HMMT Nov 2025MathArena (ETH Zurich SRI Lab), problems by HMMT13377/4523
68MRCRGoogle DeepMind1232237/4522
69Video-MMMUNTU S-Lab (LMMs-Lab)11367/4520
70OfficeQA ProDatabricks110147/4516
71OpenAI MRCROpenAI83147/4516
72Harvey LABHarvey2712127/4515
73Arena-HardArena (formerly LMArena)12187/4512
74SWE-MarathonAbundant AI22357/4512
75ProgramBench almost solvedMeta Superintelligence Labs, Stanford University and Harvard University112137/458
76SuperGPQAByteDance Seed + M-A-P162256/4525
77ERQAGoogle DeepMind1171146/4524
78WMT24++Google31151226/4524
79HealthBenchOpenAI111836/4523
80ZeroBenchUniversity of Cambridge and others112366/4522
81MedXpertQA-MMTsinghua University (TsinghuaC3I)6111126/4521
82MMVUYale NLP10166/4517
83WideSearchByteDance Seed7106/4517
84CountBenchGoogle Research111136/4516
85AA-BriefcaseArtificial Analysis71256/4515
86ChartographySurge AI261326/4514
87SkillsBenchBenchFlow + 105 domain experts7166/4514
88Terminal-Bench-ScienceStanford-led community (Terminal-Bench team + domain experts)23536/4513
89BrowseComp-ZHResearchers from Peking University, Mindverse AI, and other groups4146/459
90GSM8KOpenAI1312116/459
91HumanEvalOpenAI13236/459
92IMOInternational Mathematical Olympiad, hosted by the Australian Maths Trust11246/458
93ProgramBenchMeta Superintelligence Labs, Stanford University and Harvard University12146/458
94ScreenSpotOS-Atlas team (Shanghai AI Lab and others)11146/457
95RealWorldQAxAI171135/4522
96Codeforces ratingCodeforces741315/4516
97BioMysteryBenchAnthropic21035/4515
98HealthBench HardOpenAI111125/4515
99VITA-BenchMeituan LongCat team1145/4515
100OfficeQADatabricks110125/4514
101V*Penghao Wu and Saining Xie81135/4513
102DRACOPerplexity845/4512
103FLEURSGoogle54125/4512
104MathArena (Apex, IMO, USAMO)ETH Zurich SRI Lab2455/4511
105Terminal-Bench HardArtificial Analysis41225/459
106WorldVQAMoonshot AI2165/459
107FrontierScienceOpenAI85/458
108InfographicVQAComputer Vision Center (UAB) and IIIT Hyderabad411115/458
109MATHUC Berkeley (Hendrycks et al.)31225/458
110WebArena-VerifiedServiceNow211125/457
111AdvancedIFMeta Superintelligence Labs65/456
112ChartQAYork University and Nanyang Technological University11125/455
113DocVQACVC, Universitat Autònoma de Barcelona and IIIT Hyderabad111115/455
114LogicVistaUCLA1135/455
115PaperBenchOpenAI145/455
116LVBenchZhipu AI / Tsinghua31444/4521
117C-EvalSJTU + Tsinghua + Edinburgh141214/4518
118MMLU-ProXUniversity of Tokyo (Li Lab) and collaborators115114/4518
119DynaMathUniversity of Illinois Urbana-Champaign and UC Berkeley1144/4515
120EmbSpatialBenchFudan University1134/4514
121MMBenchShanghai AI Laboratory (OpenCompass)111114/4514
122RULERNVIDIA46114/4512
123ProgramBench tests passedMeta Superintelligence Labs, Stanford University and Harvard University8124/4511
124OJBenchBeijing University of Posts and Telecommunications, Tsinghua University, and others644/4510
125BBEH micro averageGoogle DeepMind6124/459
126GDPvalOpenAI51124/459
127MATH-500OpenAI3334/459
128VoiceBenchCUHK-Shenzhen3244/459
129Beyond AIMEByteDance Seed164/457
130HellaSwagUniversity of Washington + AllenAI31214/457
131MGSMGoogle Research13214/457
132MMAUUniversity of Maryland3134/457
133USAMOMathematical Association of America (contest), MathArena (evaluation)4124/457
134We-MathBeijing University of Posts and Telecommunications434/457
135Audio MCScale AI11134/456
136BigCodeBenchBigCode project12214/456
137CL-benchTencent Hunyuan (with Fudan University authors)154/456
138LMArena (Elo)Arena (formerly LMArena)31114/456
139MBPPGoogle Research334/456
140ResearchRubricsScale AI64/456
141Big Bench AudioArtificial Analysis1224/455
142BIG-Bench HardSuzgun et al. (Stanford University and Google Research)1224/455
143ChartQA Provis-nlp (Masry et al.)144/455
144Chinese SimpleQAAlibaba (Taobao & Tmall)1224/455
145CVBenchNew York University (Cambrian-1 team)2124/455
146FinSearchCompByteDance Seed54/455
147LibriSpeechPanayotov et al. (Johns Hopkins University)2124/455
148LiveCodeBench ProLiveCodeBench Pro team11214/455
149MMSI-BenchShanghai AI Lab (OpenRobotLab) and collaborators144/455
150PerceptionBench (Moonshot)Moonshot AI1134/455
151WebDev ArenaArena (formerly LMArena)2124/455
152WildClawBenchInternLM (Shanghai AI Lab)1134/455
153MathVerseCUHK MMLab and Shanghai AI Laboratory44/454
154Online-Mind2WebOhio State University (OSU NLP Group)1124/454
155PutnamBenchUT Austin (Tsoukalas et al.)11114/454
156WebVoyagerWebVoyager team (He et al., ACL 2024)1124/454
157MMLU-ReduxUniversity of Edinburgh16113/4518
158INCLUDEEPFL and Cohere For AI11413/4516
159MLVUBAAI + partners1423/4516
160MMLongBench-DocYubo Ma et al.10213/4513
161BenchCADBenchCAD team4713/4512
162CursorBenchCursor7233/4512
163SWE-bench MultimodalSWE-bench team (Princeton/Stanford)11013/4512
164VLMs Are BlindAuburn University and University of Alberta823/4510
165MCPMarkeval-sys (MCPMark team)543/459
166Multi-IFMeta7113/459
167Claw-Eval-MMClaw-Eval team623/458
168MLE-benchOpenAI2423/458
169Vending-BenchAndon Labs1523/458
170Vision2WebZ.ai (zai-org)4213/457
171AGIEvalMicrosoft3213/456
172Artificial Analysis Coding Agent IndexArtificial Analysis4113/456
173Seal-0Virginia Tech423/456
174Daily-OmniZiwei Zhou, Rui Wang et al.3113/455
175FrontierScience-ResearchOpenAI2123/455
176LongVideoBenchNTU S-Lab et al.53/455
177MLS-BenchMLS-Bench authors (Bohan Lyu et al.)233/455
178WinoGrandeAllenAI3113/455
179Bird-SQLHKU and Alibaba DAMO Academy1213/454
180Full-Duplex-BenchGuan-Ting Lin, Hung-yi Lee and collaborators (National Taiwan University and others)1213/454
181Global MMLU LiteCohere Labs133/454
182IMO-ProofBenchGoogle DeepMind (Superhuman Reasoning team)223/454
183SpreadsheetBenchRenmin University (RUCKBReasoning)223/454
184Vals IndexVals AI223/454
185VisuLogicShanghai AI Laboratory with several universities43/454
186WebArenaCarnegie Mellon University2113/454
187WenetSpeechNorthwestern Polytechnical University (ASLP@NPU), Mobvoi and others223/454
188$OneMillion-BenchHumanlaya + BIGAI + xbench123/453
189AMO-BenchMeituan LongCat Team33/453
190ArtifactsBenchTencent Hunyuan33/453
191BrowseComp-VLAlibaba Tongyi Lab1113/453
192EnterpriseOps-GymServiceNow123/453
193MindCubeMLL Lab, Northwestern University, with Stanford, NYU, and University of Washington123/453
194MM-BrowseCompByteDance Seed and collaborators (Li et al.)123/453
195PhyXHui Shen et al.123/453
196PresentBenchPresentBench team123/453
197SpreadsheetBench 2Renmin University of China (RUCKBReasoning)33/453
198SWE-Bench Pro V2 HardScale AI (co-developed with Reflection)33/453
199TriviaQAUniversity of Washington1113/453
200ViewSpatial-BenchDingming Li, Yueting Zhuang et al.123/453
201WorkSpaceBenchSJTU + ByteDance (OpenDataBox)123/453

How this is counted

A release is one launch post. When a lab put out several models under one post, that's one release. The system cards, model cards and technical reports that came with a post count toward the same release. A benchmark counts once per release, however many settings, subsets or documents report it, and with or without a score.

Versions of one test count as one benchmark in the graphics, so Terminal-Bench 2.0 and 3.0 are both Terminal-Bench. Tests with their own task sets stay apart, like SWE-bench Verified, SWE-Bench Pro and SWE-bench Multilingual. The lookup can show every version on its own.

A benchmark's color and shape come from its area, the same eight areas the rest of the almanac uses. Safety, alignment, bio and cyber evaluations are left out until you switch them on. Most come from system cards, and only a few labs publish those.

The quarterly chart counts 2024 as one column, because we have only 31 launch posts with scores from that year. The spread chart only shows benchmarks released since 2025, so the first lab we saw name one is the first lab that did.

"Frontier labs only" counts just the releases of the nine labs whose best 2026 models score highest on Epoch AI's Capabilities Index, as of November 2026. Every count on the page then compares those labs with each other, and the spread chart asks how fast a benchmark reached them.

We only count what labs reported themselves. Leaderboard and Epoch AI scores don't count here. Every number links back to its source on the benchmark's page and the model's page, and the Model cards page lists every post we read.