DeepSeek-R1 May 2025
DeepSeek-R1 ranks first on USAMO 2025.
DeepSeek Released 28 May 2025 82
Benchmarks with a score
1
Ranked first, out of five or more models
3
In the top three
DeepSeek May 2025 DeepSeek-R1
May 2025 snapshot Open weights
141.2
#118 of 271
Epoch Capabilities Index
- MathArena (Apex, IMO, USAMO) 1.04% #36 /47
- SimpleQA Verified 28.6% #33 /56
- GPQA Diamond 76.3% #96 /219
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| FaithJudge | 9.78% | #4 of 37 | Official leaderboard | |
| MMLU-Pro | 84% | #37 of 212 | Official leaderboard | |
| FACTS Grounding | 82.4% | #7 of 34 | Official leaderboard | |
| LongBench v2 | 56.7% | #7 of 33 | Official leaderboard | |
| BuzzBench | 62.7 | #5 of 23 | Official leaderboard | |
| WritingBench | 78.9 | #10 of 45 | Official leaderboard | |
| Vectara Hallucination Leaderboard (HHEM) | 7.70% | #34 of 148 | Official leaderboard | |
| Fiction.LiveBench | 75% | #14 of 57 | Epoch AI | |
| Lech Mazur Creative Writing | 8.19 | #12 of 44 | Epoch AI | |
| LMArena (Elo) | 1,421 | #103 of 333 | Official leaderboard | |
| LLM Confabulation Leaderboard | 14.6% | #20 of 58 | Official leaderboard | |
| EQ-Bench 3 | 1,292 | #36 of 78 | Official leaderboard | |
| Creative Writing v3 | 68.3 | #60 of 120 | Official leaderboard | |
| Longform Creative Writing (EQ-Bench) | 59.5 | #64 of 119 | Official leaderboard | |
| ECLeKTic | 17.5% | #19 of 35 | Official leaderboard | |
| MultiNRC | 27.6% | #21 of 38 | Official leaderboard | |
| SimpleQA Verified | 28.6% | #33 of 56 | Official leaderboard | |
| FACTS Parametric | 20.8% | #32 of 45 | Official leaderboard | |
| Vectara Hallucination Leaderboard (2025 dataset) | 11.3% | #74 of 104 | Official leaderboard | |
| Slop Score | 67.9 | #13 of 17 | Official leaderboard | |
| BullshitBench | 12.7% | #92 of 107 | Official leaderboard | |
| Phare | 58.5% | #55 of 62 | Official leaderboard | |
| Global MMLU Lite | 67.4% | #39 of 43 | Official leaderboard | |
| BullshitBench V2 | 8.00% | #111 of 122 | Official leaderboard |
Math and science
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| Misguided Attention | 67.1% | #3 of 45 | Official leaderboard | |
| MATH Level 5 | 96.6% | #7 of 94 | Epoch AI | |
| USAMO 2025 | 30.1% | #1 of 10 | Official leaderboard | |
| PHYBench | 33.5% | #9 of 28 | Official leaderboard | |
| HiPhO | 59.6% | #12 of 35 | Official leaderboard | |
| AIME 2025 | 89.2% | #21 of 53 | Official leaderboard | |
| BRUMO 2025 | 92.5% | #17 of 42 | Official leaderboard | |
| AMO-Bench | 34.3% | #9 of 21 | Official leaderboard | |
| GPQA Diamond | 76.3% | #96 of 219 | Epoch AI | |
| HMMT 2025 | 76.7% | #26 of 53 | Official leaderboard | |
| OTIS Mock AIME 2024-2025 | 66.4% | #109 of 202 | Epoch AI | |
| ForecastBench | 63.3 | #50 of 86 | Official leaderboard | |
| SMT 2025 | 83% | #26 of 40 | Official leaderboard | |
| SimpleBench | 40.8% | #67 of 100 | Official leaderboard | |
| MathArena (Apex, IMO, USAMO) | 1.04% | #36 of 47 | Official leaderboard | |
| CMIMC 2025 | 71.3% | #27 of 33 | Official leaderboard | |
| ARC-AGI | 21.2% | #77 of 92 | Official leaderboard | |
| ARC-AGI-2 | 1.12% | #80 of 95 | Official leaderboard | |
| CORE-Bench | 8.89% | #17 of 17 | Official leaderboard | |
| IMO 2025 | 6.85% | #6 of 6 | Official leaderboard | |
| ATLAS (OpenCompass) | 26.4% | #5 of 5 | Official leaderboard |
Coding
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| LiveCodeBench v5 | 74.8% | #3 of 21 | Official leaderboard | |
| AutoCodeBench | 50.2% | #5 of 34 | Official leaderboard | |
| LiveCodeBench v6 | 73.1% | #4 of 21 | Official leaderboard | |
| Aider Polyglot | 71.4% | #12 of 54 | Epoch AI | |
| AlgoTune | 1.70× | #7 of 18 | Official leaderboard | |
| METR Time Horizon | 33 min | #14 of 31 | Official leaderboard | |
| LiveSQLBench | 24.5% | #18 of 36 | Official leaderboard | |
| Bird-SQL | 60.9% | #7 of 13 | Official leaderboard | |
| ALE-Bench | 804 | #68 of 121 | Epoch AI | |
| MLE-bench | 36.4% | #7 of 12 | Official leaderboard | |
| ArtifactsBench | 47.7% | #12 of 20 | Official leaderboard | |
| WeirdML | 41.6% | #71 of 112 | Official leaderboard |
Agents and tools
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| Elimination Game | 5 | #8 of 56 | Official leaderboard | |
| Berkeley Function Calling Leaderboard (BFCL) | 63.8% | #19 of 67 | Official leaderboard | |
| Step Race | 3 | #18 of 59 | Official leaderboard | |
| LLM Chess | 300 | #48 of 124 | Official leaderboard | |
| VitaBench 2.0 | 39.6% | #8 of 20 | Official leaderboard | |
| AgentBench FC | 49.3% | #5 of 12 | Official leaderboard | |
| LisanBench | 288.7 | #82 of 133 | Official leaderboard | |
| DeepResearch Bench | 35.1% | #23 of 24 | Epoch AI | |
| ITBench | 23.3% | #13 of 13 | Official leaderboard |
Professional work
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| LEXam | 55.9% | #9 of 31 | Official leaderboard | |
| MedHELM | 56.5 | #5 of 13 | Official leaderboard | |
| TaxEval v2 | 72.3% | #63 of 129 | Official leaderboard | |
| CorpFin v2 | 54.1% | #89 of 119 | Official leaderboard | |
| PRBench | 36.6% | #39 of 44 | Official leaderboard | |
| LegalBench | 67.3% | #124 of 138 | Official leaderboard | |
| FailureSensorIQ | 29.1% | #24 of 24 | Official leaderboard |
Safety and security
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| BaxBench | 39% | #10 of 34 | Official leaderboard | |
| Anthropic Red Team | 99.1% | #37 of 75 | Official leaderboard | |
| SimpleSafetyTests | 98.3% | #46 of 75 | Official leaderboard | |
| Human Pathogen Capabilities Test v2 (HPCT v2) | 46.4% | #49 of 71 | Official leaderboard | |
| HELM Safety | 89.4 | #53 of 75 | Official leaderboard | |
| AIR-Bench 2024 | 52.9% | #61 of 82 | Official leaderboard | |
| Spiral-Bench v1.2 | 14.2 | #21 of 21 | Official leaderboard | |
| Spiral-Bench v1.0 | 22.4 | #13 of 13 | Official leaderboard |
Other
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| HELM Capabilities | 69.9 | #22 of 60 | Official leaderboard |
DeepSeek's models over time
DeepSeek's models in color, against every other model on the Epoch Capabilities Index, by release date.