Benchmark Almanac

Who held number one

We track which model had the best score on each benchmark at every point since 2023. A model takes the top spot on the day its score beats every earlier one, and keeps it until another model beats it. A tie leaves the holder in place.

The top spot on the capability index has changed hands 21 times since 2023

GPT-6 Astra, from OpenAI, holds it now. The longest run at the top since 2023 was 8 months.

Meta OpenAI Anthropic Google DeepMind
Capabilities Index 21 leaders
GPT-6 Astra 169.1

OpenAI held number one 33% of the contested time

Each lab’s share of the days its models held number one, across 333 benchmarks with enough scores, lab claims included. We count only contested time. A benchmark’s clock stops when its best score passes 85%, or at its newest score once 45 days go by without another. A new version doesn’t stop the old one’s clock while people still test it.

OpenAI 33% Anthropic 20% Google DeepMind 14% Qwen 11% ByteDance Seed 4% xAI 3% Other labs 2% Meta 2% Z.ai 2% Moonshot AI 1% DeepSeek 1% Shanghai AI Lab 1% Mistral AI 1% MiniMax 1% Physical Intelligence 1% NVIDIA 1%

The longest runs at the top

Lab claims included, counted from January 2023 and only while the benchmark was contested.

  1. 26 months GPT-4o on OR-Bench May 2024 to Jul 2026
  2. 19 months o3-mini on LiveBench Jan 2025 to Sep 2026
  3. 18 months o1-mini on AgentIF May 2025 to now
  4. 18 months GLM-4 on LongBench Jan 2024 to Jul 2025
  5. 17 months Qwen2-72B on AlGhafa Jun 2024 to Nov 2025
  6. 16 months Claude 3.5 Sonnet on Aider-Edit Jun 2024 to Oct 2025
  7. 16 months Gemma 1.1 2B IT on Vectara Hallucination Leaderboard (HHEM) Apr 2024 to Jul 2025
  8. 15 months o1-preview on KOR-Bench Oct 2024 to Dec 2025

OpenAI closed out 51 of 152 benchmarks

A close-out goes to the model that first took a benchmark past 85%. We count these separately from time at number one.

OpenAI 51 Anthropic 34 Google DeepMind 17 Qwen 13 Meta 5 DeepSeek 5 Shanghai AI Lab 4 Moonshot AI 3 ByteDance Seed 3 Other labs 3 xAI 2 Baidu 2 StepFun 1 LG AI Research 1 Thinking Machines 1 Xiaomi Corp 1 Meituan 1 MiniMax 1 Physical Intelligence 1 Perplexity 1 Microsoft 1 Z.ai 1
DateBenchmarkClosed out byScore
Oct 2026 CyScenarioBench Gemini 4 Argon 100%
Oct 2026 DistressBench Muse Spark 1.2 88.4%
Oct 2026 SAGE v1.1 (Vals) Claude Opus 5.5 91.3%
Sep 2026 SWE-Bench Pro Claude Opus 5.5 89.9%
Sep 2026 AA-LCR 1.1 Step 5 Preview 88.3%
Sep 2026 AI Detection Benchmark GPT-6 Astra 95.8%
Sep 2026 FrontierMath Tier 4 GPT-6 Astra 97.6%
Sep 2026 ARC-AGI-3 GPT-6 Astra 100%
Sep 2026 MLE-bench GPT-6 Astra 93.8%
Sep 2026 o11y-bench GPT-6 Astra 87.5%
Sep 2026 ARC-AGI-3 GPT-6 Astra 100%
Sep 2026 Time Horizon Index: KSP GPT-6 Astra 90.5%
Sep 2026 BenchCAD GPT-6 Astra 95.9%
Sep 2026 ExploitBench GPT-6 Astra 100%
Sep 2026 SEC-bench Pro GPT-6 Astra 85.4%
Sep 2026 SRE-Bench GPT-6 Astra 99.2%
Sep 2026 SimpleBench Claude Fable 5.1 86.6%
Sep 2026 CritPt Claude Fable 5.1 88.4%
Sep 2026 SWE-Bench Pro V2 Claude Opus 5 99.4%
Sep 2026 LiveBench Claude Fable 5.1 85.7%
Aug 2026 LVBench Gemini 3.7 Flash 85.4%
Aug 2026 1H-VideoQA Gemini 3.7 Flash 89.1%
Aug 2026 OpenAI MRCR K-EXAONE 2.0 94.4%
Aug 2026 HiPhO Qwen 3.8 Max 90%
Aug 2026 PaperBench Qwen 3.8 Max 93%
Aug 2026 MMStar Qwen 3.8 Max 85.9%
Aug 2026 ProofBench v1.1 Claude Opus 5 99%
Jul 2026 Drone-Bench Claude Opus 5 86.9%
Jul 2026 MCPMark Kimi K3 94.5%
Jul 2026 Harvey LAB (Legal Agent Benchmark) Kimi K3 94.6%
Jul 2026 Global MMLU Lite 3.0 Inkling 88.7%
Jul 2026 Parametric CAD Bench Grok 4.5 88.1%
Jul 2026 OpenAI MRCR v2 GPT-5.6 Terra 89.6%
Jul 2026 MCP Atlas Muse Spark 1.1 88.1%
Jul 2026 CyberBench (Vals) GPT-5.6 Sol 88.1%
Jul 2026 PolicyBench GPT-5.5 88%
Jun 2026 GDPval Seed2.1 Pro 87.9%
Jun 2026 ProofBench Claude Fable 5 95%
Jun 2026 FrontierMath Tier 4 v2 Claude Fable 5 90.2%
Jun 2026 Vibe Code Bench Claude Fable 5 90.3%
Jun 2026 WeirdML Claude Fable 5 92%
Jun 2026 Terminal-Bench 2.1 Claude Fable 5 88%
Jun 2026 OSWorld-Verified Claude Fable 5 86%
Jun 2026 Pencil Puzzle Bench Claude Fable 5 97.6%
Jun 2026 FrontierMath Tiers 1-3 v2 GPT-5.5 Pro 87.7%
May 2026 GraphWalks Claude Opus 4.8 99.3%
May 2026 MMLU-ProX Qwen3.7-Max 87%
May 2026 MRCR v2 Qwen3.7-Max 90.4%
May 2026 AndroidWorld Gemini 3.5 Flash 93.1%
May 2026 PinchBench 2.0 MiMo-V2.5 89.7%
Apr 2026 ARC-AGI-2 GPT-5.5 85%
Apr 2026 ARC-AGI-2 GPT-5.5 85%
Apr 2026 OfficeQA Claude Opus 4.7 86.3%
Apr 2026 Dictatorship Eval Claude Opus 4.7 88.3%
Apr 2026 SWE-bench Verified Claude Mythos Preview 93.9%
Apr 2026 SWE-bench Multilingual Claude Mythos Preview 87.3%
Apr 2026 MASK Claude Mythos Preview 95.4%
Mar 2026 BullshitBench V2 Claude Sonnet 4.6 91%
Mar 2026 tau3-bench Qwen3.5 397B-A17B 87.9%
Feb 2026 BrowseComp Gemini 3.1 Pro 85.9%
Feb 2026 INCLUDE Qwen3.5 397B-A17B 85.6%
Feb 2026 MLVU Qwen3.5 397B-A17B 86.7%
Feb 2026 DeepSearchQA Claude Opus 4.6 91.3%
Feb 2026 Cybench Claude Opus 4.6 93%
Feb 2026 CyberGym Claude Opus 4.6 91%
Feb 2026 Chinese SimpleQA ERNIE 5.0 86%
Feb 2026 Multi-IF ERNIE 5.0 85.6%
Feb 2026 BullshitBench Claude Opus 4.5 90.9%
Feb 2026 AIME 2026 GPT-5.2 98.3%
Feb 2026 HMMT 2026 GPT-5.2 97%
Feb 2026 PinchBench Gemini 3 Flash 87%
Feb 2026 MedScribe GPT-5.1 88.1%
Jan 2026 IMO-AnswerBench LongCat-Flash-Thinking-2601 86.8%
Dec 2025 CVE-Bench GPT-5.2 Codex 87%
Dec 2025 ARC-AGI GPT-5.2 94.5%
Dec 2025 ScreenSpot-Pro GPT-5.2 86.3%
Dec 2025 GAIA GPT-5.2 86%
Dec 2025 ARC-AGI GPT-5.2 94.5%
Dec 2025 CharXiv GPT-5.2 88.7%
Dec 2025 LiveCodeBench DeepSeek-V3.2-Speciale 88.7%
Nov 2025 Extended NYT Connections Gemini 3 Pro 94.4%
Nov 2025 MATH-Vision (MathVision) Gemini 3 Pro 86.6%
Nov 2025 Video-MMMU Gemini 3 Pro 87.6%
Nov 2025 VPCT Gemini 3 Pro 91%
Nov 2025 MMMU GPT-5.1 85.4%
Oct 2025 tau2-bench MiniMax-M2 87%
Sep 2025 VoiceBench Qwen3-Omni-30B-A3B 88.8%
Sep 2025 Online-Mind2Web UI-TARS-2 88.2%
Aug 2025 COLLIE GPT-5 99%
Aug 2025 Aider Polyglot GPT-5 88%
Aug 2025 LegalBench GPT-5 86%
Aug 2025 LiveCodeBench v6 Gemini 2.5 Deep Think 87.6%
Aug 2025 CompileBench Claude Sonnet 4 93.3%
Jul 2025 OTIS Mock AIME 2024-2025 Qwen3-235B-A22B-Thinking Jul 2025 86.7%
Jul 2025 Vectara Hallucination Leaderboard (HHEM) Kimi K2 Jul 2025 98.9%
Jul 2025 HMMT 2025 Grok 4 Heavy 96.7%
Jun 2025 GPQA Diamond Gemini 2.5 Pro Jun 2025 86.4%
Jun 2025 Video-MME Gemini 2.5 Pro Jun 2025 86.9%
Jun 2025 DTBench o3-pro 86.9%
Apr 2025 Fiction.LiveBench o3 88.9%
Apr 2025 Arena-Hard v2.0 o3 85.9%
Apr 2025 ScreenSpot-v2 UI-TARS-1.5 94.2%
Apr 2025 MathVista o3 86.8%
Feb 2025 StrongREJECT OpenAI deep research 93%
Feb 2025 MMMLU Claude 3.7 Sonnet 86.1%
Feb 2025 FACTS Grounding Gemini 2.0 Flash Feb 2025 85.6%
Feb 2025 Global MMLU Lite Gemini 2.0 Pro 86.5%
Feb 2025 LIBERO π0 94.2%
Feb 2025 AIME 2025 o3-mini 86.7%
Feb 2025 ZebraLogic o3-mini 91.7%
Jan 2025 AIME 2024 o3-mini 87.3%
Jan 2025 ScreenSpot Qwen2.5-VL-72B 87.1%
Jan 2025 OCRBench Qwen2.5-VL-72B 88.5%
Jan 2025 WebVoyager OpenAI Computer-Using Agent (CUA) 87%
Jan 2025 SimpleQA Sonar Pro 85.8%
Jan 2025 AlpacaEval 2.0 DeepSeek-R1 87.6%
Jan 2025 BBQ (Bias Benchmark for QA) DeepSeek-R1 96.6%
Dec 2024 C-Eval DeepSeek-V3 86.5%
Dec 2024 Arena-Hard-Auto DeepSeek-V3 85.5%
Dec 2024 CCBench (MMBench Chinese Culture) InternVL2.5-78B-MPO 86.9%
Dec 2024 MMLU-Pro o1 89.3%
Dec 2024 MATH Gemini 2.0 Flash Dec 2024 89.7%
Sep 2024 MATH Level 5 o1-mini 89.2%
Sep 2024 MATH-500 o1-preview 85.5%
Aug 2024 RULER Phi-3.5-MoE 87.1%
Jul 2024 IFEval Llama 3.1-405B 88.6%
Jul 2024 Berkeley Function Calling Leaderboard (BFCL) Llama 3.1-405B 88.5%
Jul 2024 MMBench-CN v1.1 InternVL2-Llama3-76B 85.5%
Jul 2024 MMBench InternVL2-40B 86.8%
Jul 2024 MMBench-EN v1.1 InternVL2-40B 85.1%
Jul 2024 AIR-Bench 2024 Claude 3.5 Sonnet 85.9%
Jun 2024 AraTrust Qwen2-72B 89.2%
Jun 2024 RepoQA Claude 3 Opus 90.6%
Jun 2024 MixEval GPT-4 Turbo Apr 2024 88.8%
May 2024 RewardBench Gemini 1.5 Pro May 2024 88.2%
May 2024 ChartQA GPT-4o May 2024 85.7%
Apr 2024 HumanEval GPT-4 Turbo Apr 2024 88.2%
Apr 2024 HumanEval+ GPT-4 Turbo Apr 2024 86.6%
Mar 2024 BIG-Bench Hard Claude 3 Opus 86.8%
Mar 2024 QuALITY Claude 3 Opus 90.5%
Mar 2024 MBPP Claude 3 Opus 86.4%
Mar 2024 AI2D Claude 3 Sonnet 88.7%
Jan 2024 Needle In A Haystack GLM-4 100%
Nov 2023 SimpleSafetyTests GPT-3.5 Turbo Jun 2023 95.8%
Jun 2023 Anthropic Red Team GPT-3.5 Turbo Jun 2023 99.6%
May 2023 PIQA PaLM 2-L 85%
May 2023 DROP PaLM 2-L 85%
May 2023 MGSM PaLM 2-L 87%
May 2023 AlpacaEval GPT-4 Mar 2023 94.8%
Mar 2023 MMLU GPT-4 Mar 2023 86.4%
Mar 2023 GSM8K GPT-4 Mar 2023 92%
Feb 2023 TriviaQA LLaMA-65B 86%

By category

Time at number one in each category, split by lab. Click one to see its benchmarks.

OpenAI held number one 36% of the contested time

Each lab’s share of the days its models held number one, across 310 benchmarks with enough scores, independent runs only. We count only contested time. A benchmark’s clock stops when its best score passes 85%, or at its newest score once 45 days go by without another. A new version doesn’t stop the old one’s clock while people still test it.

OpenAI 36% Anthropic 23% Google DeepMind 20% Qwen 6% xAI 3% Meta 2% Other labs 2% DeepSeek 1% ByteDance Seed 1% Physical Intelligence 1% Shanghai AI Lab 1% Alibaba Group 1% Technology Innovation Institute 1% Fixie.ai (Ultravox) 1%

The longest runs at the top

Independent runs only, counted from January 2023 and only while the benchmark was contested.

  1. 19 months Gemma 1.1 2B IT on Vectara Hallucination Leaderboard (HHEM) Apr 2024 to Nov 2025
  2. 17 months Gemini 2.5 Pro on LiveBench Mar 2025 to Sep 2026
  3. 14 months Qwen2-72B on AlGhafa Jun 2024 to Aug 2025
  4. 14 months gpt-oss-120b on FORTRESS Aug 2025 to Sep 2026
  5. 13 months Gemini 1.5 Pro on Video-MME May 2024 to Jun 2025
  6. 11 months o3 on CharXiv Apr 2025 to Mar 2026
  7. 11 months Qwen2.5-72B on ArabicMMLU Sep 2024 to Aug 2025
  8. 11 months Qwen2.5-72B on ArbMMLU-HT Sep 2024 to Aug 2025

OpenAI closed out 39 of 86 benchmarks

A close-out goes to the model that first took a benchmark past 85%. We count these separately from time at number one.

OpenAI 39 Anthropic 22 Google DeepMind 12 Qwen 4 Shanghai AI Lab 4 Meta 3 Xiaomi Corp 1 xAI 1
DateBenchmarkClosed out byScore
Oct 2026 Code Migration v1.1 Claude Sonnet 5.5 86.9%
Oct 2026 BrowseSafe++ GPT-6 Astra 91.5%
Oct 2026 DistressBench Muse Spark 1.2 88.4%
Oct 2026 SAGE v1.1 (Vals) Claude Opus 5.5 91.3%
Sep 2026 AI Detection Benchmark GPT-6 Astra 95.8%
Sep 2026 ARC-AGI-3 GPT-6 Astra 100%
Sep 2026 Terminal-Bench 2.1 GPT-6 Astra 87.4%
Sep 2026 o11y-bench GPT-6 Astra 87.5%
Sep 2026 ARC-AGI-3 GPT-6 Astra 100%
Sep 2026 Time Horizon Index: KSP GPT-6 Astra 90.5%
Sep 2026 SimpleBench Claude Fable 5.1 86.6%
Sep 2026 SWE-Bench Pro V2 Claude Opus 5 99.4%
Sep 2026 LiveBench Claude Fable 5.1 85.7%
Aug 2026 1H-VideoQA Gemini 3.7 Flash 89.1%
Aug 2026 ProofBench v1.1 Claude Opus 5 99%
Jul 2026 Drone-Bench Claude Opus 5 86.9%
Jul 2026 FACTS Search V2 GPT-5.6 Sol 88.5%
Jul 2026 MCP Atlas Muse Spark 1.1 88.1%
Jul 2026 CyberBench (Vals) GPT-5.6 Sol 88.1%
Jul 2026 PolicyBench GPT-5.5 88%
Jun 2026 ProofBench Claude Fable 5 95%
Jun 2026 FrontierMath Tier 4 v2 Claude Fable 5 90.2%
Jun 2026 Vibe Code Bench Claude Fable 5 90.3%
Jun 2026 WeirdML Claude Fable 5 92%
Jun 2026 OSWorld-Verified Claude Fable 5 86%
Jun 2026 Pencil Puzzle Bench Claude Fable 5 97.6%
Jun 2026 BabyVision Claude Fable 5 90.5%
Jun 2026 FrontierMath Tiers 1-3 v2 GPT-5.5 Pro 87.7%
May 2026 AndroidWorld Gemini 3.5 Flash 93.1%
May 2026 PinchBench 2.0 MiMo-V2.5 89.7%
Apr 2026 ARC-AGI-2 GPT-5.5 85%
Apr 2026 ARC-AGI-2 GPT-5.5 85%
Apr 2026 Dictatorship Eval Claude Opus 4.7 88.3%
Mar 2026 BullshitBench V2 Claude Sonnet 4.6 91%
Mar 2026 tau3-bench Qwen3.5 397B-A17B 87.9%
Feb 2026 FACTS Search Gemini 3.1 Pro 85.6%
Feb 2026 Cybench Claude Opus 4.6 93%
Feb 2026 CyberGym Claude Opus 4.6 91%
Feb 2026 BullshitBench Claude Opus 4.5 90.9%
Feb 2026 AIME 2026 GPT-5.2 98.3%
Feb 2026 HMMT 2026 GPT-5.2 97%
Feb 2026 PinchBench Gemini 3 Flash 87%
Feb 2026 MedScribe GPT-5.1 88.1%
Dec 2025 ARC-AGI GPT-5.2 94.5%
Dec 2025 GAIA GPT-5.2 86%
Dec 2025 ARC-AGI GPT-5.2 94.5%
Nov 2025 Extended NYT Connections Gemini 3 Pro 94.4%
Nov 2025 tau2-bench Gemini 3 Pro 85.4%
Nov 2025 MATH-Vision (MathVision) Gemini 3 Pro 86.6%
Nov 2025 VPCT Gemini 3 Pro 91%
Nov 2025 MMMU GPT-5.1 85.4%
Sep 2025 VoiceBench Qwen3-Omni-30B-A3B 88.8%
Aug 2025 Aider Polyglot GPT-5 88%
Aug 2025 LegalBench GPT-5 86%
Aug 2025 CompileBench Claude Sonnet 4 93.3%
Jul 2025 OTIS Mock AIME 2024-2025 Qwen3-235B-A22B-Thinking Jul 2025 86.7%
Jul 2025 HMMT 2025 Grok 4 95%
Jun 2025 GPQA Diamond Gemini 2.5 Pro Jun 2025 85.3%
Jun 2025 DTBench o3-pro 86.9%
Apr 2025 Fiction.LiveBench o3 88.9%
Apr 2025 Arena-Hard v2.0 o3 85.9%
Apr 2025 Global MMLU Lite GPT-4.1 87.5%
Feb 2025 FACTS Grounding Gemini 2.0 Flash Feb 2025 85.6%
Feb 2025 AIME 2025 o3-mini 86.7%
Feb 2025 ZebraLogic o3-mini 91.7%
Dec 2024 CCBench (MMBench Chinese Culture) InternVL2.5-78B-MPO 86.9%
Dec 2024 MMLU-Pro o1 89.3%
Sep 2024 MATH Level 5 o1-mini 89.2%
Jul 2024 PIQA GPT-4o mini 88.7%
Jul 2024 MMBench-CN v1.1 InternVL2-Llama3-76B 85.5%
Jul 2024 MMBench InternVL2-40B 86.8%
Jul 2024 MMBench-EN v1.1 InternVL2-40B 85.1%
Jul 2024 AIR-Bench 2024 Claude 3.5 Sonnet 85.9%
Jun 2024 AraTrust Qwen2-72B 89.2%
Jun 2024 RepoQA Claude 3 Opus 90.6%
Jun 2024 MixEval GPT-4 Turbo Apr 2024 88.8%
May 2024 BIG-Bench Hard Gemini 1.5 Pro May 2024 89.2%
May 2024 RewardBench Gemini 1.5 Pro May 2024 88.2%
Apr 2024 HumanEval+ GPT-4 Turbo Apr 2024 86.6%
Nov 2023 OpenBookQA GPT-3.5 Turbo Nov 2023 86%
Nov 2023 SimpleSafetyTests GPT-3.5 Turbo Jun 2023 95.8%
Jun 2023 Anthropic Red Team GPT-3.5 Turbo Jun 2023 99.6%
May 2023 AlpacaEval GPT-4 Mar 2023 94.8%
Mar 2023 MMLU GPT-4 Mar 2023 86.4%
Mar 2023 GSM8K GPT-4 Mar 2023 92%
Feb 2023 TriviaQA LLaMA-65B 86%

By category

Time at number one in each category, split by lab. Click one to see its benchmarks.