Benchmark Almanac

AIME 2025

Grok 4 Heavy 100% leads since Jul 2025 In use

Models answer the 30 problems from the 2025 AIME I and II exams. Each answer is an integer from 0 to 999, scored by match.

The problems were published in February 2025, so models trained later may have seen them.

Made by Mathematical Association of America (MAA) Released Feb 2025 Competition problems with answers All tasks public Last in a launch post Aug 2026 Last model added Aug 2026 Scores refreshed 2 Nov 2026
Level
Competition The strongest students, in olympiad-style contests
Scored
Checked automatically A program checks the result against an answer key, unit tests or the expected final state.
Answers
Short answer A number, word or short string matched to a key.
eth-sri/matharena 294 stars Dataset Leaderboard
143
Models scored in lab cards
129
Launch posts list it, from 37 labs
81
System cards report it, from 29 labs

8 models share the top score of 100% among models released by Aug 2026

Best score per model as labs report them in their own cards. Labs pick their own settings, so these compare less cleanly than independent runs.

The newest model with a score here came out in Aug 2026, and nobody has reported a newer one. Among the 20 highest-ranked models on the capability index, these have no score yet:

143 models. Scroll sideways for the rest.

  1. 100.0 Grok 4 Heavy
  2. 100.0 GPT-5
  3. 100.0 Qwen3-Max
  4. 100.0 Claude Sonnet 4.5
  5. 100.0 Gemini 3 Pro
  6. 100.0 GPT-5.2
  7. 100.0 GPT-5.2 Pro
  8. 100.0 LongCat-Flash-Thinking-2601
  9. 99.8 Claude Opus 4.6
  10. 99.7 Gemini 3 Flash
  11. 99.2 Gemini 2.5 Deep Think
  12. 98.8 Grok 4
  13. 98.7 gpt-oss-20b
  14. 98.3 Seed2.0 Pro
  15. 97.9 gpt-oss-120b
  16. 97.3 Step 3.5 Flash
  17. 97.0 MAI-Thinking-1
  18. 96.3 Claude Haiku 4.5
  19. 96.3 Trinity Large Thinking
  20. 96.1 Kimi K2.5
  21. 96.0 DeepSeek-V3.2-Speciale
  22. 95.7 GLM-4.7
  23. 95.6 Claude Sonnet 4.6
  24. 94.5 Kimi K2 Thinking
  25. 94.3 Seed1.8
  26. 94.1 MiMo-V2-Flash
  27. 94.0 GPT-5.1
  28. 94.0 MiniMax-M2.7
  29. 93.9 GLM-4.6
  30. 93.4 Ring-1T
  31. 93.3 Grok 3
  32. 93.1 DeepSeek-V3.2
  33. 93.1 Intern-S1-Pro
  34. 92.9 EXAONE 4.5 33B
  35. 92.8 K-EXAONE
  36. 92.8 Claude Opus 4.5
  37. 92.7 o4-mini
  38. 92.4 Nemotron-Cascade 2 30B-A3B
  39. 92.3 Qwen3-235B-A22B-Thinking
  40. 92.3 Nova 2.0 Pro Preview
  41. 92.1 Nova 2 Omni Preview
  42. 92.0 Grok 4 Fast
  43. 91.6 glm-4.7-flash
  44. 91.1 GPT-5 mini
  45. 91.0 Nova 2 Lite
  46. 90.8 Grok-3 mini
  47. 90.6 LongCat-Flash-Thinking
  48. 90.2 Nemotron 3 Super
  49. 90.0 Claude Opus 4
  50. 90.0 Command A+
  51. 89.7 Qwen3-VL-235B-A22B
  52. 89.5 Cogito v2.1
  53. 89.3 DeepSeek-V3.2-Exp
  54. 89.2 Granite 4.2 30B
  55. 89.1 Nemotron 3 Nano 30B-A3B
  56. 89.1 ERNIE 5.0
  57. 88.9 o3
  58. 88.4 DeepSeek-V3.1
  59. 88.3 Sarvam 105B
  60. 88.0 Gemini 2.5 Pro
  61. 88.0 INTELLECT-3
  62. 87.8 Qwen3-Next-80B-A3B
  63. 87.7 STEP3-VL-10B
  64. 87.5 DeepSeek-R1
  65. 86.7 Gemini 2.5 Pro
  66. 86.7 Keye-VL-2.0-30B-A3B
  67. 86.3 MiniMax-M2.5
  68. 86.3 Mistral Medium 3.5
  69. 86.0 Seed1.6-Thinking
  70. 86.0 Intern-S1
  71. 85.3 EXAONE 4.0 32B
  72. 85.2 GPT-5 nano
  73. 85.0 Claude Sonnet 4
  74. 85.0 Ministral 3 14B
  75. 84.7 seed-oss-36b-instruct
  76. 84.3 Solar Open 100B
  77. 83.8 Mistral Small 4
  78. 83.5 Magistral Medium 1.2
  79. 83.3 Magistral Medium 1.0
  80. 83.1 Falcon H1R 7B
  81. 83.1 qwen3-coder-next
  82. 83.0 MiniMax-M2.1
  83. 82.9 Step 3
  84. 82.7 Llama-3.3-Nemotron-Super-49B-v1.5
  85. 82.1 Nemotron 3 Nano Omni 30B-A3B
  86. 81.5 Qwen3-235B-A22B
  87. 81.2 GPT-5.5 Instant
  88. 80.3 Solar Pro 3
  89. 80.0 Sarvam 30B
  90. 78.5 Nemotron 3 Nano 4B
  91. 78.1 Hermes 4 405B
  92. 78.1 Olmo 3.1 32B Think
  93. 78.0 ERNIE-4.5-21B-A3B-Thinking
  94. 78.0 Gemini 2.5 Flash
  95. 78.0 Phi-4-Reasoning-plus
  96. 78.0 Claude Opus 4.1
  97. 78.0 MiniMax-M2
  98. 77.3 Magistral Small 1.2
  99. 76.9 MiniMax-M1-80k
  100. 76.8 Hunyuan-A13B-Instruct
  101. 75.6 InternVL3.5-241B-A28B
  102. 75.6 Gemini 2.5 Flash
  103. 74.0 Seed-Thinking-v1.5
  104. 72.9 Qwen3-32B
  105. 72.9 Baichuan-M2-32B
  106. 72.5 Llama-3.1-Nemotron-Ultra-253B-v1
  107. 72.5 Olmo 3 32B Think
  108. 72.1 nvidia-nemotron-nano-9b-v2
  109. 72.0 Gemini 2.5 Flash
  110. 71.3 Nemotron Nano 12B v2 VL
  111. 70.9 Qwen3-30B-A3B
  112. 70.4 Qwen3-14B
  113. 69.3 Hermes 4.3 36B
  114. 69.1 Solar Pro 2
  115. 68.2 Code World Model (CWM)
  116. 67.3 Qwen3-8B
  117. 65.8 EXAONE Deep 32B
  118. 65.6 Qwen3-4B
  119. 65.0 Qwen3-Omni-30B-A3B
  120. 64.9 INTELLECT-2
  121. 63.6 GLM-Z1-32B-0414
  122. 63.1 Phi-4-reasoning
  123. 63.1 Gemini 2.5 Flash-Lite
  124. 62.8 Magistral Small 1.0
  125. 62.0 Magistral Small 1.1
  126. 61.3 LongCat-Flash-Chat
  127. 61.0 Magistral Medium 1.1
  128. 60.0 Llama-3.3-Nemotron-Super-49B-v1
  129. 55.4 MiMo-7B-RL
  130. 51.9 LFM2.5-2.6B
  131. 50.0 Reka Flash 3
  132. 49.5 Kimi K2
  133. 48.2 Gemini 2.5 Flash-Lite
  134. 42.5 LFM2.5-8B-A1B
  135. 36.8 Qwen3-1.7B
  136. 35.1 ERNIE-4.5-300B-A47B
  137. 33.6 Phi-4-mini-flash-reasoning
  138. 31.7 LFM2.5-1.2B-Thinking
  139. 24.4 Trinity Large Preview
  140. 16.7 Falcon-H1-34B
  141. 16.0 Amazon Nova Premier
  142. 14.0 LFM2.5-1.2B-Instruct
  143. 11.6 Gemma 3n E4B
  1. 1 Grok 4 Heavy 100%
  2. 2 GPT-5 100%
  3. 3 Qwen3-Max 100%
  4. 4 Claude Sonnet 4.5 100%
  5. 5 Gemini 3 Pro 100%
  6. 6 GPT-5.2 100%
  7. 7 GPT-5.2 Pro 100%
  8. 8 LongCat-Flash-Thinking-2601 100%
  9. 9 Claude Opus 4.6 99.8%
  10. 10 Gemini 3 Flash 99.7%
  11. 11 Gemini 2.5 Deep Think 99.2%
  12. 12 Grok 4 98.8%
  13. 13 gpt-oss-20b 98.7%
  14. 14 Seed2.0 Pro 98.3%
  15. 15 gpt-oss-120b 97.9%
  16. 16 Step 3.5 Flash 97.3%
  17. 17 MAI-Thinking-1 97%
  18. 18 Claude Haiku 4.5 96.3%
  19. 19 Trinity Large Thinking 96.3%
  20. 20 Kimi K2.5 96.1%
  21. 21 DeepSeek-V3.2-Speciale 96%
  22. 22 GLM-4.7 95.7%
  23. 23 Claude Sonnet 4.6 95.6%
  24. 24 Kimi K2 Thinking 94.5%
  25. 25 Seed1.8 94.3%
  26. 26 MiMo-V2-Flash 94.1%
  27. 27 GPT-5.1 94%
  28. 28 MiniMax-M2.7 94%
  29. 29 GLM-4.6 93.9%
  30. 30 Ring-1T 93.4%
  31. 31 Grok 3 93.3%
  32. 32 DeepSeek-V3.2 93.1%
  33. 33 Intern-S1-Pro 93.1%
  34. 34 EXAONE 4.5 33B 92.9%
  35. 35 K-EXAONE 92.8%
  36. 36 Claude Opus 4.5 92.8%
  37. 37 o4-mini 92.7%
  38. 38 Nemotron-Cascade 2 30B-A3B 92.4%
  39. 39 Qwen3-235B-A22B-Thinking Jul 2025 92.3%
  40. 40 Nova 2.0 Pro Preview 92.3%
  41. 41 Nova 2 Omni Preview 92.1%
  42. 42 Grok 4 Fast 92%
  43. 43 glm-4.7-flash 91.6%
  44. 44 GPT-5 mini 91.1%
  45. 45 Nova 2 Lite 91%
  46. 46 Grok-3 mini 90.8%
  47. 47 LongCat-Flash-Thinking 90.6%
  48. 48 Nemotron 3 Super 90.2%
  49. 49 Claude Opus 4 90%
  50. 50 Command A+ 90%
  51. 51 Qwen3-VL-235B-A22B 89.7%
  52. 52 Cogito v2.1 89.5%
  53. 53 DeepSeek-V3.2-Exp 89.3%
  54. 54 Granite 4.2 30B 89.2%
  55. 55 Nemotron 3 Nano 30B-A3B 89.1%
  56. 56 ERNIE 5.0 89.1%
  57. 57 o3 88.9%
  58. 58 DeepSeek-V3.1 88.4%
  59. 59 Sarvam 105B 88.3%
  60. 60 Gemini 2.5 Pro Jun 2025 88%
  61. 61 INTELLECT-3 88%
  62. 62 Qwen3-Next-80B-A3B 87.8%
  63. 63 STEP3-VL-10B 87.7%
  64. 64 DeepSeek-R1 87.5%
  65. 65 Gemini 2.5 Pro Mar 2025 86.7%
  66. 66 Keye-VL-2.0-30B-A3B 86.7%
  67. 67 MiniMax-M2.5 86.3%
  68. 68 Mistral Medium 3.5 86.3%
  69. 69 Seed1.6-Thinking 86%
  70. 70 Intern-S1 86%
  71. 71 EXAONE 4.0 32B 85.3%
  72. 72 GPT-5 nano 85.2%
  73. 73 Claude Sonnet 4 85%
  74. 74 Ministral 3 14B 85%
  75. 75 seed-oss-36b-instruct 84.7%
  76. 76 Solar Open 100B 84.3%
  77. 77 Mistral Small 4 83.8%
  78. 78 Magistral Medium 1.2 83.5%
  79. 79 Magistral Medium 1.0 83.3%
  80. 80 Falcon H1R 7B 83.1%
  81. 81 qwen3-coder-next 83.1%
  82. 82 MiniMax-M2.1 83%
  83. 83 Step 3 82.9%
  84. 84 Llama-3.3-Nemotron-Super-49B-v1.5 82.7%
  85. 85 Nemotron 3 Nano Omni 30B-A3B 82.1%
  86. 86 Qwen3-235B-A22B 81.5%
  87. 87 GPT-5.5 Instant 81.2%
  88. 88 Solar Pro 3 80.3%
  89. 89 Sarvam 30B 80%
  90. 90 Nemotron 3 Nano 4B 78.5%
  91. 91 Hermes 4 405B 78.1%
  92. 92 Olmo 3.1 32B Think 78.1%
  93. 93 ERNIE-4.5-21B-A3B-Thinking 78%
  94. 94 Gemini 2.5 Flash Apr 2025 78%
  95. 95 Phi-4-Reasoning-plus 78%
  96. 96 Claude Opus 4.1 78%
  97. 97 MiniMax-M2 78%
  98. 98 Magistral Small 1.2 77.3%
  99. 99 MiniMax-M1-80k 76.9%
  100. 100 Hunyuan-A13B-Instruct 76.8%
  101. 101 InternVL3.5-241B-A28B 75.6%
  102. 102 Gemini 2.5 Flash Sep 2025 75.6%
  103. 103 Seed-Thinking-v1.5 74%
  104. 104 Qwen3-32B 72.9%
  105. 105 Baichuan-M2-32B 72.9%
  106. 106 Llama-3.1-Nemotron-Ultra-253B-v1 72.5%
  107. 107 Olmo 3 32B Think 72.5%
  108. 108 nvidia-nemotron-nano-9b-v2 72.1%
  109. 109 Gemini 2.5 Flash Jun 2025 72%
  110. 110 Nemotron Nano 12B v2 VL 71.3%
  111. 111 Qwen3-30B-A3B 70.9%
  112. 112 Qwen3-14B 70.4%
  113. 113 Hermes 4.3 36B 69.3%
  114. 114 Solar Pro 2 69.1%
  115. 115 Code World Model (CWM) 68.2%
  116. 116 Qwen3-8B 67.3%
  117. 117 EXAONE Deep 32B 65.8%
  118. 118 Qwen3-4B 65.6%
  119. 119 Qwen3-Omni-30B-A3B 65%
  120. 120 INTELLECT-2 64.9%
  121. 121 GLM-Z1-32B-0414 63.6%
  122. 122 Phi-4-reasoning 63.1%
  123. 123 Gemini 2.5 Flash-Lite Jun 2025 63.1%
  124. 124 Magistral Small 1.0 62.8%
  125. 125 Magistral Small 1.1 62%
  126. 126 LongCat-Flash-Chat 61.3%
  127. 127 Magistral Medium 1.1 61%
  128. 128 Llama-3.3-Nemotron-Super-49B-v1 60%
  129. 129 MiMo-7B-RL 55.4%
  130. 130 LFM2.5-2.6B 51.9%
  131. 131 Reka Flash 3 50%
  132. 132 Kimi K2 Jul 2025 49.5%
  133. 133 Gemini 2.5 Flash-Lite Sep 2025 48.2%
  134. 134 LFM2.5-8B-A1B 42.5%
  135. 135 Qwen3-1.7B 36.8%
  136. 136 ERNIE-4.5-300B-A47B 35.1%
  137. 137 Phi-4-mini-flash-reasoning 33.6%
  138. 138 LFM2.5-1.2B-Thinking 31.7%
  139. 139 Trinity Large Preview 24.4%
  140. 140 Falcon-H1-34B 16.7%
  141. 141 Amazon Nova Premier 16%
  142. 142 LFM2.5-1.2B-Instruct 14%
  143. 143 Gemma 3n E4B 11.6%
#ModelScoreSettingDateSource
1 Grok 4 Heavy 100% Jul 2025 Model card
2 GPT-5 100% Aug 2025 Model card
3 Qwen3-Max 100% Sep 2025 Model card
4 Claude Sonnet 4.5 100% Sep 2025 Model card
5 Gemini 3 Pro 100% Nov 2025 Model card
6 GPT-5.2 100% Dec 2025 Model card
7 GPT-5.2 Pro 100% Dec 2025 Model card
8 LongCat-Flash-Thinking-2601 100% Jan 2026 Model card
9 Claude Opus 4.6 99.8% Feb 2026 Model card
10 Gemini 3 Flash 99.7% Dec 2025 Model card
11 Gemini 2.5 Deep Think 99.2% Aug 2025 Model card
12 Grok 4 98.8% Jul 2025 Model card
13 gpt-oss-20b 98.7% Aug 2025 Model card
14 Seed2.0 Pro 98.3% Feb 2026 Model card
15 gpt-oss-120b 97.9% Aug 2025 Model card
16 Step 3.5 Flash 97.3% Feb 2026 Model card
17 MAI-Thinking-1 97% Jun 2026 Model card
18 Claude Haiku 4.5 96.3% Oct 2025 Model card
19 Trinity Large Thinking 96.3% Apr 2026 Model card
20 Kimi K2.5 96.1% Jan 2026 Model card
21 DeepSeek-V3.2-Speciale 96% Dec 2025 Model card
22 GLM-4.7 95.7% Dec 2025 Model card
23 Claude Sonnet 4.6 95.6% Feb 2026 Model card
24 Kimi K2 Thinking 94.5% Nov 2025 Model card
25 Seed1.8 94.3% Dec 2025 Model card
26 MiMo-V2-Flash 94.1% Dec 2025 Model card
27 GPT-5.1 94% Nov 2025 Model card
28 MiniMax-M2.7 94% May 2026 Model card
29 GLM-4.6 93.9% Sep 2025 Model card
30 Ring-1T 93.4% Oct 2025 Model card
31 Grok 3 93.3% Feb 2025 Model card
32 DeepSeek-V3.2 93.1% Dec 2025 Model card
33 Intern-S1-Pro 93.1% Feb 2026 Model card
34 EXAONE 4.5 33B 92.9% Apr 2026 Model card
35 K-EXAONE 92.8% Dec 2025 Model card
36 Claude Opus 4.5 92.8% Nov 2025 Model card
37 o4-mini 92.7% Apr 2025 Model card
38 Nemotron-Cascade 2 30B-A3B 92.4% Mar 2026 Model card
39 Qwen3-235B-A22B-Thinking Jul 2025 92.3% Jul 2025 Model card
40 Nova 2.0 Pro Preview 92.3% Dec 2025 Model card
41 Nova 2 Omni Preview 92.1% Dec 2025 Model card
42 Grok 4 Fast 92% Sep 2025 Model card
43 glm-4.7-flash 91.6% Jan 2026 Model card
44 GPT-5 mini 91.1% Aug 2025 Model card
45 Nova 2 Lite 91% Dec 2025 Model card
46 Grok-3 mini 90.8% Feb 2025 Model card
47 LongCat-Flash-Thinking 90.6% Sep 2025 Model card
48 Nemotron 3 Super 90.2% Mar 2026 Model card
49 Claude Opus 4 90% May 2025 Model card
50 Command A+ 90% May 2026 Model card
51 Qwen3-VL-235B-A22B 89.7% Sep 2025 Model card
52 Cogito v2.1 89.5% Nov 2025 Model card
53 DeepSeek-V3.2-Exp 89.3% Sep 2025 Model card
54 Granite 4.2 30B 89.2% Aug 2026 Model card
55 Nemotron 3 Nano 30B-A3B 89.1% Dec 2025 Model card
56 ERNIE 5.0 89.1% Feb 2026 Model card
57 o3 88.9% Apr 2025 Model card
58 DeepSeek-V3.1 88.4% Aug 2025 Model card
59 Sarvam 105B 88.3% Mar 2026 Model card
60 Gemini 2.5 Pro Jun 2025 88% Jun 2025 Model card
61 INTELLECT-3 88% Nov 2025 Model card
62 Qwen3-Next-80B-A3B 87.8% Sep 2025 Model card
63 STEP3-VL-10B 87.7% Jan 2026 Model card
64 DeepSeek-R1 87.5% May 2025 Model card
65 Gemini 2.5 Pro Mar 2025 86.7% Mar 2025 Model card
66 Keye-VL-2.0-30B-A3B 86.7% May 2026 Model card
67 MiniMax-M2.5 86.3% Feb 2026 Model card
68 Mistral Medium 3.5 86.3% May 2026 Model card
69 Seed1.6-Thinking 86% Jun 2025 Model card
70 Intern-S1 86% Jul 2025 Model card
71 EXAONE 4.0 32B 85.3% Jul 2025 Model card
72 GPT-5 nano 85.2% Aug 2025 Model card
73 Claude Sonnet 4 85% May 2025 Model card
74 Ministral 3 14B 85% Dec 2025 Model card
75 seed-oss-36b-instruct 84.7% Aug 2025 Model card
76 Solar Open 100B 84.3% Dec 2025 Model card
77 Mistral Small 4 83.8% Mar 2026 Model card
78 Magistral Medium 1.2 83.5% Sep 2025 Model card
79 Magistral Medium 1.0 83.3% Jun 2025 Model card
80 Falcon H1R 7B 83.1% Jan 2026 Model card
81 qwen3-coder-next 83.1% Feb 2026 Model card
82 MiniMax-M2.1 83% Dec 2025 Model card
83 Step 3 82.9% Jul 2025 Model card
84 Llama-3.3-Nemotron-Super-49B-v1.5 82.7% Jul 2025 Model card
85 Nemotron 3 Nano Omni 30B-A3B 82.1% Apr 2026 Model card
86 Qwen3-235B-A22B 81.5% Apr 2025 Model card
87 GPT-5.5 Instant 81.2% May 2026 Model card
88 Solar Pro 3 80.3% Jan 2026 Model card
89 Sarvam 30B 80% Mar 2026 Model card
90 Nemotron 3 Nano 4B 78.5% Mar 2026 Model card
91 Hermes 4 405B 78.1% Aug 2025 Model card
92 Olmo 3.1 32B Think 78.1% Dec 2025 Model card
93 ERNIE-4.5-21B-A3B-Thinking 78% Sep 2025 Model card
94 Gemini 2.5 Flash Apr 2025 78% Apr 2025 Model card
95 Phi-4-Reasoning-plus 78% Apr 2025 Model card
96 Claude Opus 4.1 78% Aug 2025 Model card
97 MiniMax-M2 78% Oct 2025 Model card
98 Magistral Small 1.2 77.3% Sep 2025 Model card
99 MiniMax-M1-80k 76.9% Jun 2025 Model card
100 Hunyuan-A13B-Instruct 76.8% Jun 2025 Model card
101 InternVL3.5-241B-A28B 75.6% Aug 2025 Model card
102 Gemini 2.5 Flash Sep 2025 75.6% Sep 2025 Model card
103 Seed-Thinking-v1.5 74% Apr 2025 Model card
104 Qwen3-32B 72.9% May 2025 Model card
105 Baichuan-M2-32B 72.9% Aug 2025 Model card
106 Llama-3.1-Nemotron-Ultra-253B-v1 72.5% Apr 2025 Model card
107 Olmo 3 32B Think 72.5% Nov 2025 Model card
108 nvidia-nemotron-nano-9b-v2 72.1% Aug 2025 Model card
109 Gemini 2.5 Flash Jun 2025 72% Jun 2025 Model card
110 Nemotron Nano 12B v2 VL 71.3% Nov 2025 Model card
111 Qwen3-30B-A3B 70.9% May 2025 Model card
112 Qwen3-14B 70.4% May 2025 Model card
113 Hermes 4.3 36B 69.3% Dec 2025 Model card
114 Solar Pro 2 69.1% Jul 2025 Model card
115 Code World Model (CWM) 68.2% Sep 2025 Model card
116 Qwen3-8B 67.3% May 2025 Model card
117 EXAONE Deep 32B 65.8% Mar 2025 Model card
118 Qwen3-4B 65.6% May 2025 Model card
119 Qwen3-Omni-30B-A3B 65% Sep 2025 Model card
120 INTELLECT-2 64.9% May 2025 Model card
121 GLM-Z1-32B-0414 63.6% Apr 2025 Model card
122 Phi-4-reasoning 63.1% Apr 2025 Model card
123 Gemini 2.5 Flash-Lite Jun 2025 63.1% Jun 2025 Model card
124 Magistral Small 1.0 62.8% Jun 2025 Model card
125 Magistral Small 1.1 62% Jul 2025 Model card
126 LongCat-Flash-Chat 61.3% Aug 2025 Model card
127 Magistral Medium 1.1 61% Jul 2025 Model card
128 Llama-3.3-Nemotron-Super-49B-v1 60% May 2025 Model card
129 MiMo-7B-RL 55.4% Apr 2025 Model card
130 LFM2.5-2.6B 51.9% Aug 2026 Model card
131 Reka Flash 3 50% Mar 2025 Model card
132 Kimi K2 Jul 2025 49.5% Jul 2025 Model card
133 Gemini 2.5 Flash-Lite Sep 2025 48.2% Sep 2025 Model card
134 LFM2.5-8B-A1B 42.5% May 2026 Model card
135 Qwen3-1.7B 36.8% May 2025 Model card
136 ERNIE-4.5-300B-A47B 35.1% Jun 2025 Model card
137 Phi-4-mini-flash-reasoning 33.6% Jul 2025 Model card
138 LFM2.5-1.2B-Thinking 31.7% Jan 2026 Model card
139 Trinity Large Preview 24.4% Feb 2026 Model card
140 Falcon-H1-34B 16.7% May 2025 Model card
141 Amazon Nova Premier 16% Apr 2025 Model card
142 LFM2.5-1.2B-Instruct 14% Jan 2026 Model card
143 Gemma 3n E4B 11.6% Jun 2025 Model card

The benchmark's own leaderboard has 53 models. We plot every source in the charts below.

The best score, 100%, costs $0.11 a task

Runs on the cost frontier score higher than any run that's cheaper. DeepSeek-V3.2-Speciale comes within 4.2 points of the best for $0.009 a task, 12 times cheaper. The costs are the leaderboard's own estimates, so compare them only within this benchmark.

xAI OpenAI DeepSeek Technology Innovation Institute StepFun Cost frontier One model at each effort level
0% 20% 40% 60% 80% 100% $0.001 $0.01 $0.10 $1.00 $10 Cost per task, log scale GPT-5.2, high Step 3.5 Flash DeepSeek-V3.2, thinking Falcon H1R 7B Grok-3 mini, low GPT-5 nano, low 0% 20% 40% 60% 80% 100% $0.001 $0.01 $0.10 $1.00 $10 Cost per task, log scale GPT-5.2, high DeepSeek-V3.2, thinking
ModelEffortHarnessScoreCost per taskOutput tokens
GPT-5.2 high 100% $0.11 7,758
GPT-5.2 xhigh 100% $0.18 12,811
Step 3.5 Flash 98.3% $0.01 37,760
Gemini 3 Flash 97.5% $0.06 18,430
GLM-5 96.7% $0.08 25,259
DeepSeek-V3.2-Speciale 95.8% $0.009 21,957
Kimi K2.5 thinking 95.8% $0.07 22,716
GPT-5 high 95% $0.14 13,475
Gemini 3 Pro 95% $0.18 14,799
GPT-5.1 high 94.2% $0.18 17,912
DeepSeek-V3.2 thinking 94.2% $0.006 14,908
GLM-4.5 93.3% $0.05 21,965
Grok 4 92.5% $0.19 12,873
Kimi K2 Thinking 92.5% $0.06 24,036
o4-mini high 91.7% $0.06 13,982
DeepSeek-V3.2-Exp thinking 91.7% $0.006 14,024
GLM-4.6 91.7% $0.04 16,491
DeepSeek-V3.1 thinking 90.8% $0.03 14,961
Grok 4 Fast 90.8% $0.005 9,160
gpt-oss-120b high 90% $0.01 21,204
o3 high 89.2% $0.10 11,885
DeepSeek-R1 May 2025 89.2% $0.05 21,923
gpt-oss-20b high 89.2% $0.008 40,223
Grok 4.1 Fast 89.2% $0.005 10,009
Gemini 2.5 Pro Mar 2025 88.3% $0.13 13,397
GPT-5 mini high 87.5% $0.03 16,431
o3-mini high 86.7% $0.05 11,392
Falcon H1R 7B 86.7% $0.004 17,859
GPT-5 nano high 85% $0.01 27,091
o4-mini medium 84.2% $0.03 6,221
Claude Sonnet 4.5 thinking 84.2% $0.26 17,251
Gemini 2.5 Pro May 2025 83.3% 4,369
GLM-4.5-Air 83.3% $0.03 24,021
K2-Think 83.3%
o1 medium 81.7% $0.71 11,813
Grok-3 mini high 81.7% $0.009 18,460
Qwen3-235B-A22B 80.8% $0.009 14,907
QED-Nano 77.5% 39,431
o3-mini medium 76.7% $0.03 6,182
Gemini 2.5 Flash Sep 2025 thinking 70.8% $0.08 23,871
DeepSeek-R1 70% $0.03 11,211
Qwen3-30B-A3B 70% $0.005 17,970
Claude Opus 4 thinking 70% $1.13 15,044
QwQ-32B 65.8% $0.02 16,133
Grok-3 mini low 65% $0.003 5,707
o4-mini low 61.7% $0.01 2,605
DeepSeek-R1-Distill-Qwen-32B 60% $0.008 12,749
DeepSeek-R1-Distill-Llama-70B 55% $0.006 10,488
Gemini 2.0 Flash Thinking Jan 2025 53.3% 569
DeepSeek-V3 Mar 2025 50% $0.004 3,440
DeepSeek-R1-Distill-Qwen-14B 49.2% $0.004 12,352
Claude 3.7 Sonnet thinking 49.2% $0.37 24,602
o3-mini low 48.3% $0.01 2,361
GPT-5 nano low 47.2% $0.001 2,172
QwQ-32B-Preview 33.3% $0.01 8,085
Gemini 2.0 Flash Feb 2025 27.5% $0.001 2,769
Gemini 2.0 Pro 27.5% $0.01 3,037
DeepSeek-V3 Mar 2025 25% $0.003 2,471
DeepSeek-R1-Distill-Qwen-1.5B 20% $0.003 17,102
GPT-4o Mar 2025 11.7% $0.009 860
Claude 3.5 Sonnet 3.33% $0.009 555

8 models have held number one since its release in Feb 2025

Lab claims count from the day the card came out, independent runs from the model’s release. We draw one row each for the benchmark’s own leaderboard and what labs claim in their cards.

OpenAI Google DeepMind xAI Z.ai DeepSeek
Own leaderboard Passed 85% in Feb 2025, by o3-mini
GPT-5.2 100%
Lab claims Passed 85% in Feb 2025, by Grok 3
Grok 4 Heavy 100%

The best score passed 85% in Jan 2025

All the scores we have, one dot each, so a model tested at several settings appears more than once.

On the benchmark’s own leaderboard Reported by the lab in its model card Best so far
0% 20% 40% 60% 80% 100% 2024 2025 2026 Near the ceiling (85%) Grok 4 Heavy Grok 3 o3-mini o1 QwQ-32B-Preview Claude 3.5 Sonnet 0% 20% 40% 60% 80% 100% 2024 2025 2026 Near the ceiling (85%) Grok 4 Heavy Grok 3

3 labs put it in a launch post in the last six months

Launch posts from every lab that has listed it, one tick per post. Tall colored ticks include it, and short gray ones leave it out.

xAI
Reka
NVIDIA
LG AI Research
Google DeepMind
ByteDance Seed
Z.ai
OpenAI
Qwen
Xiaomi Corp
Microsoft
Amazon
Prime Intellect
Technology Innovation Institute
Anthropic
DeepSeek
Mistral AI
MiniMax
Tencent
Baidu
Upstage
Moonshot AI
Shanghai AI Lab
StepFun
Baichuan
Nous Research
Meituan
Meta
Ant Group
Deep Cogito
Ai2
Liquid AI
Arcee AI
Sarvam AI
Cohere
Kuaishou
IBM
DateLaunch postScoreAs the post writes it
25 Aug 2026 Granite 4.2 30B 89.2 AIME25
4 Aug 2026 LFM2.5-2.6B 51.9 AIME25
2 Jun 2026 MAI-Thinking-1 97 AIME 2025
28 May 2026 LFM2.5-8B-A1B 42.5 AIME25
25 May 2026 Keye-VL-2.0-30B-A3B 86.7 AIME2025
22 May 2026 Mistral Medium 3.5 86.3 AIME25 avg@16
20 May 2026 Command A+ 90 AIME 25 (pass@1 over 10 repeats)
5 May 2026 GPT-5.5 Instant 81.2 AIME 2025 (Competition Math)
9 Apr 2026 EXAONE 4.5 33B 92.9 AIME 2025
1 Apr 2026 Trinity Large Thinking 96.3 AIME25
19 Mar 2026 Nemotron-Cascade 2 30B-A3B 92.4 AIME 2025 (TIR 98.6)
16 Mar 2026 Nemotron 3 Nano 4B 78.5 AIME25 (reasoning on)
16 Mar 2026 Mistral Small 4 83.8 AIME25 [Mistral Small 4 - High]
11 Mar 2026 Nemotron 3 Super 90.2 AIME25 (no tools)
6 Mar 2026 Sarvam 30B 80 AIME 25 (80.0 without tools, 96.7 with tools)
6 Mar 2026 Sarvam 105B 88.3 AIME 25 (88.3 without tools, 96.7 with tools)
14 Feb 2026 Seed2.0 Pro 98.3 AIME 2025
12 Feb 2026 MiniMax-M2.5 86.3 AIME25
6 Feb 2026 ERNIE 5.0 89.1 AIME 2025
2 Feb 2026 Intern-S1-Pro 93.1 AIME-2025
2 Feb 2026 Step 3.5 Flash 97.3 AIME 2025
27 Jan 2026 Trinity Large Preview 24 AIME 2025
27 Jan 2026 Kimi K2.5 96.1 AIME 2025
26 Jan 2026 Solar Pro 3 80.3 AIME 2025
20 Jan 2026 LFM2.5-1.2B-Thinking 31.7 AIME25 (± 1.81)
19 Jan 2026 glm-4.7-flash 91.6 AIME 25
14 Jan 2026 LongCat-Flash-Thinking-2601 100 Best of AIME-25 (Avg@16) w/ tools 99.6 / Heavy Thinking 100.0
13 Jan 2026 STEP3-VL-10B 87.7 AIME 2025 (SeRe)
5 Jan 2026 Falcon H1R 7B 83.1 AIME-25
5 Jan 2026 LFM2.5-1.2B-Instruct 14 AIME25
31 Dec 2025 Solar Open 100B 84.3 AIME 2025
31 Dec 2025 K-EXAONE 92.8 AIME 2025
23 Dec 2025 MiniMax-M2.1 83 AIME25
22 Dec 2025 GLM-4.7 95.7 AIME 2025
18 Dec 2025 Seed1.8 94.3 AIME-25
17 Dec 2025 Gemini 3 Flash 99.7 AIME 2025, With code execution; No tools = 95.2%
16 Dec 2025 MiMo-V2-Flash 94.1 AIME 2025
15 Dec 2025 Nemotron 3 Nano 30B-A3B 89.1 AIME25 (no tools)
12 Dec 2025 Olmo 3.1 32B Think 78.1 AIME 2025
11 Dec 2025 GPT-5.2 Pro 100 AIME 2025 (no tools)
11 Dec 2025 GPT-5.2 100 AIME 2025 (no tools) Competition math
3 Dec 2025 Hermes 4.3 36B 69.3 AIME 25
2 Dec 2025 Ministral 3 14B 85 AIME25 0.850 (reasoning)
2 Dec 2025 Nova 2 Omni Preview 92.1 AIME 2025 acc
2 Dec 2025 Nova 2 Lite 91 AIME 2025 acc
2 Dec 2025 Nova 2.0 Pro Preview 92.3 AIME 2025 acc
1 Dec 2025 DeepSeek-V3.2 93.1 AIME 2025 (Pass@1)
26 Nov 2025 INTELLECT-3 88 AIME25
20 Nov 2025 Olmo 3 32B Think 72.5 AIME 2025
19 Nov 2025 Cogito v2.1 89.5 AIME 2025
18 Nov 2025 Gemini 3 Pro 100 AIME 2025, With code execution; No tools = 95.0%
13 Nov 2025 GPT-5.1 94 AIME 2025 (no tools)
6 Nov 2025 Kimi K2 Thinking 94.5 AIME25, no tools
27 Oct 2025 MiniMax-M2 78 AIME25 (AA)
15 Oct 2025 Claude Haiku 4.5 96.3 High school math competition AIME 2025 (python)
10 Oct 2025 Ring-1T 93.4 AIME 25 (pass@1)
30 Sep 2025 GLM-4.6 93.9 AIME 25
29 Sep 2025 DeepSeek-V3.2-Exp 89.3 AIME 2025
29 Sep 2025 Claude Sonnet 4.5 100 High school math competition AIME 2025 (python)
25 Sep 2025 Gemini 2.5 Flash-Lite 48.2 AIME 2025, Thinking (non-thinking 50.1)
25 Sep 2025 Gemini 2.5 Flash 75.6 AIME 2025 single attempt, model card
24 Sep 2025 Code World Model (CWM) 68.2 AIME25
24 Sep 2025 Qwen3-Max 100 AIME 25 (Thinking Heavy w/ Python)
23 Sep 2025 Qwen3-VL-235B-A22B 89.7 AIME25
22 Sep 2025 Qwen3-Omni-30B-A3B 65 AIME25
21 Sep 2025 LongCat-Flash-Thinking 90.6 AIME25(Mean@32)
19 Sep 2025 Grok 4 Fast 92 AIME 2025 (no tools) pass@1
17 Sep 2025 Magistral Small 1.2 77.3 AIME25 pass@1
17 Sep 2025 Magistral Medium 1.2 83.5 AIME25 pass@1
11 Sep 2025 Qwen3-Next-80B-A3B 87.8 AIME25
9 Sep 2025 ERNIE-4.5-21B-A3B-Thinking 78 AIME2025 (Avg@32)
29 Aug 2025 LongCat-Flash-Chat 61.3 AIME25(avg@10)
26 Aug 2025 Hermes 4 405B 78.1 AIME'25 (reasoning)
25 Aug 2025 InternVL3.5-241B-A28B 75.6 AIME25
21 Aug 2025 DeepSeek-V3.1 88.4 AIME 2025 (Pass@1)
20 Aug 2025 seed-oss-36b-instruct 84.7 AIME25
18 Aug 2025 nvidia-nemotron-nano-9b-v2 72.1 AIME25
10 Aug 2025 Baichuan-M2-32B 72.9 AIME25
7 Aug 2025 GPT-5 nano 85.2 AIME '25 (no tools)
7 Aug 2025 GPT-5 mini 91.1 AIME '25 (no tools)
7 Aug 2025 GPT-5 100 AIME 2025 Competition math, GPT-5 pro (python)
5 Aug 2025 gpt-oss-20b 98.7 AIME 2025 (tools)
5 Aug 2025 Claude Opus 4.1 78 High school math competition AIME 2025
5 Aug 2025 gpt-oss-120b 97.9 AIME 2025 (tools)
1 Aug 2025 Gemini 2.5 Deep Think 99.2 AIME 2025
31 Jul 2025 Step 3 82.9 AIME25
25 Jul 2025 Llama-3.3-Nemotron-Super-49B-v1.5 82.7 AIME 2025 (pass@1, avg of 16)
25 Jul 2025 Qwen3-235B-A22B-Thinking 92.3 AIME25
24 Jul 2025 Magistral Small 1.1 62 AIME25 pass@1
24 Jul 2025 Magistral Medium 1.1 61 AIME25 pass@1
24 Jul 2025 Intern-S1 86 AIME2025
15 Jul 2025 EXAONE 4.0 32B 85.3 AIME 2025 (reasoning)
11 Jul 2025 Kimi K2 49.5 AIME 2025, Avg@64
10 Jul 2025 Solar Pro 2 69.1 AIME'25 pass@1
9 Jul 2025 Phi-4-mini-flash-reasoning 33.6 AIME25
9 Jul 2025 Grok 4 98.8 AIME'25, with Python (no tools 91.7)
9 Jul 2025 Grok 4 Heavy 100 AIME'25 (Competition Math) [Grok 4 Heavy, Python]
30 Jun 2025 ERNIE-4.5-300B-A47B 35.1 AIME'25
27 Jun 2025 Hunyuan-A13B-Instruct 76.8 AIME 2025
26 Jun 2025 Gemma 3n E4B 11.6 AIME 2025 0-shot (IT)
25 Jun 2025 Seed1.6-Thinking 86 AIME2025
17 Jun 2025 Gemini 2.5 Flash 72 AIME 2025 single attempt
17 Jun 2025 Gemini 2.5 Flash-Lite 63.1 AIME 2025, Thinking
17 Jun 2025 Gemini 2.5 Pro 88 AIME 2025, single attempt (pass@1)
16 Jun 2025 MiniMax-M1-80k 76.9 AIME 2025
10 Jun 2025 Magistral Small 1.0 62.8 AIME25 pass@1
10 Jun 2025 Magistral Medium 1.0 83.3 AIME-25 (maj@64; maj@4 = 72.1, pass@1 = 64.9)
28 May 2025 DeepSeek-R1 87.5 AIME 2025 (Pass@1)
22 May 2025 Claude Sonnet 4 85 High school math competition AIME 2025 (parallel test-time compute)
22 May 2025 Claude Opus 4 90 High school math competition AIME 2025 (parallel test-time compute)
20 May 2025 Falcon-H1-34B 16.7 AIME-25
11 May 2025 INTELLECT-2 64.9 AIME25
30 Apr 2025 Phi-4-reasoning 62.9 AIME 25
30 Apr 2025 Amazon Nova Premier 16 AIME 2025
30 Apr 2025 Phi-4-Reasoning-plus 78 AIME 25
29 Apr 2025 MiMo-7B-RL 55.4 AIME 2025 (Pass@1)
29 Apr 2025 Qwen3-235B-A22B 81.5 AIME’25
17 Apr 2025 Gemini 2.5 Flash 78 AIME 2025 single attempt
16 Apr 2025 o4-mini 92.7 AIME 2025 (no tools)
16 Apr 2025 o3 88.9 AIME 2025 Competition Math, o3 (no tools)
14 Apr 2025 GLM-Z1-32B-0414 63.6 AIME25
10 Apr 2025 Seed-Thinking-v1.5 74 AIME 2025
7 Apr 2025 Llama-3.1-Nemotron-Ultra-253B-v1 72.5 AIME25 (reasoning on)
25 Mar 2025 Gemini 2.5 Pro 86.7 AIME 2025, single attempt (pass@1)
18 Mar 2025 EXAONE Deep 32B 65.8 AIME 2025 pass@1 65.8 (cons@64 80.0)
18 Mar 2025 Llama-3.3-Nemotron-Super-49B-v1 58.4 AIME25 (reasoning on)
10 Mar 2025 Reka Flash 3 50 AIME'25 (cons@64)
19 Feb 2025 Grok-3 mini 90.8 AIME'25 (cons@64; pass@1 = 82.0) [Grok 3 mini Think]
19 Feb 2025 Grok 3 93.3 AIME'25 (cons@64; pass@1 = 77.3)

81 system cards report it, from 29 labs

Besides launch posts, we read the system cards, model cards and technical reports labs publish with a release. They report far more, including safety and frontier-risk tests.

DateDocumentScoreAs the document writes itSection
9 Jun 2026 Keye-VL-2.0-30B-A3B technical report 86.7 AIME2025 (Figure 5, printed value) Capabilities
2 Jun 2026 MAI-Thinking-1 technical report 97 AIME 2025, pass@1, 256k max output tokens, avg of 4 runs (Table 11) Capabilities
26 May 2026 MiniMax-M2 technical report 78 AIME 2025, MiniMax-M2 bar, printed label (Figure 9) Capabilities
26 May 2026 MiniMax-M2.7 technical report 94 AIME 2025, printed bar label (Figure 9) Capabilities
26 May 2026 MiniMax-M2.5 technical report 86.3 AIME 2025, printed bar label (Figure 9) Capabilities
27 Apr 2026 Nemotron 3 Nano Omni 30B-A3B technical report 82.1 AIME25 (no tools), pass@1 average of 8 runs (Table 10) Capabilities
26 Mar 2026 Intern-S1-Pro technical report 93.1 AIME-2025, thinking (Table 2) Capabilities
21 Mar 2026 Seed1.8 model card 94.3 AIME-25 (Table 1). Avg@10, 97.3 with increased thinking (Table 7) Capabilities
19 Mar 2026 Nemotron-Cascade 2 30B-A3B technical report 92.4 AIME 2025, no tools (Table 1). TIR 98.6 Capabilities
11 Mar 2026 Nemotron 3 Super technical report 90.2 AIME25 (no tools) (Table 5) Capabilities
28 Feb 2026 qwen3-coder-next technical report 83.1 AIME25 (Table 9) Capabilities
19 Feb 2026 Trinity Large Preview technical report 24.4 AIME25, Trinity Large Preview (Table 4) Capabilities
17 Feb 2026 Claude Sonnet 4.6 system card 95.6 AIME 2025, no tools, adaptive thinking, max effort, average of 10 trials (2.10) Capabilities
14 Feb 2026 Seed2.0 Pro model card 98.3 AIME 2025 (Table 3) Capabilities
11 Feb 2026 Step 3.5 Flash technical report 97.3 AIME 2025, avg of 64 (Table 5). PaCoRe 99.9, with Python 99.8 (Table 12) Capabilities
5 Feb 2026 Claude Opus 4.6 system card 99.8 AIME 2025, no tools, adaptive thinking, max effort, average of 5 trials, possible contamination noted (2.12) Capabilities
4 Feb 2026 ERNIE 5.0 technical report 89.1 AIME 2025 (Table 2) Capabilities
30 Jan 2026 Kimi K2.5 technical report 96.1 AIME 2025, Avg@64 (Table 4) Capabilities
23 Jan 2026 LongCat-Flash-Thinking-2601 technical report 100 AIME-25 (Avg@16), w/ tools, heavy mode (Table 2). Default mode 99.6 Capabilities
14 Jan 2026 STEP3-VL-10B technical report 87.7 AIME2025, SeRe (Tables 2 and 3). PaCoRe 94.43 Capabilities
13 Jan 2026 Ministral 3 14B technical report 85 AIME 2025, reported as pass@16 (Table 5) Capabilities
11 Jan 2026 Solar Open 100B technical report 84.3 AIME 2025 (Table 6) Capabilities
6 Jan 2026 MiMo-V2-Flash technical report 94.1 AIME 2025 (Table 9) Capabilities
5 Jan 2026 Falcon H1R 7B technical report 83.1 AIME25 pass@1 (Table 4). DeepConf@512 96.7 (Table 7) Capabilities
5 Jan 2026 K-EXAONE technical report 92.8 AIME 2025 (Table 3, Reasoning mode). Non-reasoning 44.6 (Table 4) Capabilities
23 Dec 2025 Nemotron 3 Nano 30B-A3B technical report 89.1 AIME25 (no tools) (Table 3). With tools 99.17 Capabilities
18 Dec 2025 INTELLECT-3 technical report 88 AIME25, Avg@32 (Table 2, Appendix A.1) Capabilities
15 Dec 2025 Olmo 3 32B Think technical report 72.5 AIME 2025, Final Think 3.0 column (Table 14) Capabilities
15 Dec 2025 Olmo 3.1 32B Think technical report 78.1 AIME 2025 (Tables 1 and 14) Capabilities
2 Dec 2025 Nova 2 Omni Preview technical report 92.1 AIME 2025 acc (Table 5) Capabilities
2 Dec 2025 Nova 2 Lite technical report 91 AIME 2025 acc (Table 1) Capabilities
2 Dec 2025 Nova 2.0 Pro Preview technical report 92.3 AIME 2025 acc (Table 1) Capabilities
1 Dec 2025 DeepSeek-V3.2 technical report 93.1 AIME 2025 (Pass@1), DeepSeek-V3.2 Thinking (Table 2) Capabilities
1 Dec 2025 DeepSeek-V3.2-Speciale technical report 96 AIME 2025 (Pass@1), 23k output tokens, DeepSeek-V3.2-Speciale (Table 3) Capabilities
26 Nov 2025 Qwen3-VL-235B-A22B technical report 89.7 AIME-25 (Table 6) Capabilities
24 Nov 2025 Claude Opus 4.5 system card 92.8 AIME 2025, no tools, 64k thinking, avg of 5 trials (2.17; 100% with python tools, possible contamination noted) Capabilities
6 Nov 2025 Nemotron Nano 12B v2 VL technical report 71.3 AIME-25, reasoning on, SFT stage 4, mean of 16 runs (Table 6) Capabilities
21 Oct 2025 Ring-1T technical report 93.4 AIME 2025 (Avg@64) (Table 1) Capabilities
30 Sep 2025 Code World Model (CWM) technical report 68.2 AIME25, pass@1 averaged over 20 samples (Table 12) Capabilities
29 Sep 2025 DeepSeek-V3.2-Exp technical report 89.3 AIME 2025 (Pass@1), DeepSeek-V3.2-Exp (Table 1) Capabilities
26 Sep 2025 Gemini 2.5 Flash model card 75.6 AIME 2025, single attempt (pass@1) (Table, p.4) Capabilities
23 Sep 2025 LongCat-Flash-Thinking technical report 90.6 AIME-25(Mean@32), no tools (Table 2). With tools 90.00 at 6,965 average tokens versus 19,653 (Figure 9) Capabilities
22 Sep 2025 Qwen3-Omni-30B-A3B technical report 65 AIME25, Instruct (Table 4). Thinking 73.7 (Table 5) Capabilities
2 Sep 2025 Baichuan-M2-32B technical report 72.9 AIME25, max_tokens 64k (Table 1) Capabilities
1 Sep 2025 LongCat-Flash-Chat technical report 61.3 AIME25 (avg@10) (Table 3) Capabilities
25 Aug 2025 InternVL3.5-241B-A28B technical report 75.6 AIME25 (Table 2, Table 14) Capabilities
25 Aug 2025 Hermes 4 405B technical report 78.1 AIME'25, reasoning mode (Table 3). Non-reasoning 10.6 Capabilities
21 Aug 2025 Intern-S1 technical report 86 AIME2025, OpenCompass version (Table 2) Capabilities
20 Aug 2025 nvidia-nemotron-nano-9b-v2 technical report 72 AIME25, NVIDIA-Nemotron-Nano-9B-v2 (Figure 1). The launch model card prints 72.1 Capabilities
5 Aug 2025 gpt-oss-20b model card 98.7 AIME 2025 (with tools), high reasoning (no tools 91.7) (Table 3, Figure 1) Capabilities
5 Aug 2025 gpt-oss-120b model card 97.9 AIME 2025 (with tools), high reasoning (no tools 92.5) (Table 3, Figure 1) Capabilities
30 Jul 2025 Falcon-H1-34B technical report 16.7 AIME-25, average accuracy over 16 repetitions (Table 24) Capabilities
21 Jul 2025 Kimi K2 technical report 49.5 AIME 2025 (Avg@64) (Table 3) Capabilities
15 Jul 2025 EXAONE 4.0 32B technical report 85.3 AIME 2025, n=32, 64K budget (Table 3, Reasoning). 32K budget 74.8, 1K 35.6 (Table 7). Non-reasoning 35.9 (Table 4) Capabilities
9 Jul 2025 Phi-4-mini-flash-reasoning technical report 33.6 AIME25, pass@1 averaged over 64 samples (Table 4) Capabilities
7 Jul 2025 Gemini 2.5 Pro technical report 88 AIME 2025, single attempt pass@1 (Table 3) Capabilities
7 Jul 2025 Gemini 2.5 Flash technical report 72 AIME 2025, single attempt pass@1 (Table 3) Capabilities
29 Jun 2025 ERNIE-4.5-300B-A47B technical report 35.1 AIME'25 (Table 5) Capabilities
26 Jun 2025 Hunyuan-A13B-Instruct technical report 76.8 AIME2025, slow-thinking (Table 3). Fast-thinking 19.2 (Table 4) Capabilities
16 Jun 2025 MiniMax-M1-80k technical report 76.9 AIME 2025, avg of 32 samples (Table 2) Capabilities
12 Jun 2025 Magistral Small 1.0 technical report 62.8 AIME'25 pass@1, SFT + RL (Magistral Small) column (Table 3). maj@64 76.7 Capabilities
12 Jun 2025 Magistral Medium 1.0 technical report 64.9 AIME'25, pass@1 averaged over 64 runs (Table 2). maj@64 83.3 Capabilities
14 May 2025 Qwen3-8B technical report 67.3 AIME’25, thinking mode (Table 17). Non-thinking 20.9 (Table 18) Capabilities
14 May 2025 Qwen3-4B technical report 65.6 AIME’25, thinking mode (Table 17). Non-thinking 19.1 (Table 18) Capabilities
14 May 2025 Qwen3-32B technical report 72.9 AIME’25, thinking mode (Table 13). Non-thinking 20.2 (Table 14) Capabilities
14 May 2025 Qwen3-30B-A3B technical report 70.9 AIME’25, thinking mode (Table 15). Non-thinking 21.6 (Table 16) Capabilities
14 May 2025 Qwen3-235B-A22B technical report 81.5 AIME’25, thinking mode (Table 11). Non-thinking 24.7 (Table 12) Capabilities
14 May 2025 Qwen3-14B technical report 70.4 AIME’25, thinking mode (Table 15). Non-thinking 23.3 (Table 16) Capabilities
14 May 2025 Qwen3-1.7B technical report 36.8 AIME’25, thinking mode (Table 19). Non-thinking 9.8 (Table 20) Capabilities
12 May 2025 MiMo-7B-RL technical report 55.4 AIME 2025 (Pass@1), average of 32 runs (Table 4, Table 5, Table 6) Capabilities
12 May 2025 INTELLECT-2 technical report 64.9 AIME25, evalchemy defaults, target length 10,000 tokens (Table 1) Capabilities
2 May 2025 Llama-3.3-Nemotron-Super-49B-v1 technical report 60 AIME25, full 30 questions, reasoning on, reasoning off 16.7 (Table 4). The launch model card prints 58.4 Capabilities
2 May 2025 Llama-3.1-Nemotron-Ultra-253B-v1 technical report 72.5 AIME25, full 30 questions, reasoning on, reasoning off 16.7 (Table 5) Capabilities
30 Apr 2025 Phi-4-reasoning technical report 63.1 AIME 25, average pass@1, std 6.3 (Table 1, Figure 8) Capabilities
30 Apr 2025 Phi-4-Reasoning-plus technical report 78 AIME 25, average pass@1 over 50 runs (Table 1) Capabilities
30 Apr 2025 Amazon Nova Premier technical report 16 AIME 2025, mean of 5 samples (Table 1) Capabilities
29 Apr 2025 Gemini 2.5 Flash model card 78 AIME 2025, single attempt (pass@1) (Table, p.4) Capabilities
28 Apr 2025 Gemini 2.5 Pro model card 86.7 AIME 2025, single attempt pass@1 (Table, p.4, column Gemini 2.5 Pro Experimental 03-25) Capabilities
10 Apr 2025 Seed-Thinking-v1.5 technical report 74 AIME 2025, mean of 32 samples (Table 2) Capabilities
16 Mar 2025 EXAONE Deep 32B technical report 65.8 AIME 2025, pass@1 with k=64, cons@64 80.0 (Table 2) Capabilities
20 Jan 2025 DeepSeek-R1 technical report 11.3 AIME 2025 average score 11.3/15, USAMO index 256.7 (Table 13) Capabilities

Versions

We switch the top row to each new version when it comes out. Open it for one row per version. An old version stays in play while people still test it, so whoever first takes it past 85% gets credit for closing it out.

OpenAI DeepSeek xAI
AIME 2026 Passed 85% in Feb 2026, by GPT-5.2
GPT-5.5 100%
AIME 2024 Passed 85% in Jan 2025, by o3-mini
gpt-oss-120b 96.6%
AIME 2025 Passed 85% in Feb 2025, by o3-mini
Grok 4 Heavy 100%
AIME 2026 Passed 85% in Feb 2026, by GPT-5.2
GPT-5.5 100%
Replaces AIME 2024 Replaces MATH-500 Replaced by AIME 2026

More in Math

All 105 in Math
  • IMO-AnswerBench In use 400 olympiad problems with short verifiable answers, robustified against memorization. Scored by answer match. GLM-5.2 91%
  • HMMT 2026 In use Models solve the 33 final-answer problems from the February 2026 Harvard-MIT Mathematics Tournament. Scored by exact answer match. GPT-5.5 98.5%
  • MathArena (Apex, IMO, USAMO) In use Evaluates models on newly released math competitions after release. Final-answer or human/LLM-judged proof scores. Claude Opus 4.8 81.3%
  • PolyMath In use Models solve 9,000 parallel math problems in 18 languages across four difficulty levels, from school math to frontier math. Final answers are checked. Qwen3.7-Max 86.5%
  • USAMO 2026 In use Models write full proofs for the six problems of the 2026 USA Mathematical Olympiad. Judges grade each proof from 0 to 7 against rubrics. GPT-5.5 98.2%
  • ArXivMath In use Final-answer research-level math problems extracted monthly from recent arXiv papers and filtered to be self-contained. GPT-6.1 Sol 94.2%