DeepSeek-V3 Mar 2025
DeepSeek-V3 places in the top three on 2 benchmarks.
DeepSeek Released 24 Mar 2025 73
Benchmarks with a score
0
Ranked first, out of five or more models
2
In the top three
DeepSeek Mar 2025 DeepSeek-V3
Mar 2025 snapshot Open weights
135.9
#143 of 271
Epoch Capabilities Index
- CritPt 0% #129 /160
- SimpleQA Verified 27.4% #35 /56
- GPQA Diamond 67.6% #112 /219
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| Vectara Hallucination Leaderboard (HHEM) | 8.00% | #30 of 148 | Official leaderboard | |
| ToRR | 49.7 | #3 of 14 | Official leaderboard | |
| MMLU-Pro | 81.3% | #50 of 212 | Official leaderboard | |
| Vectara Hallucination Leaderboard (2025 dataset) | 6.10% | #26 of 104 | Official leaderboard | |
| ECLeKTic | 22% | #13 of 35 | Official leaderboard | |
| LMArena (Elo) | 1,395 | #134 of 333 | Official leaderboard | |
| BuzzBench | 51.6 | #11 of 23 | Official leaderboard | |
| AgentIF | 56.7% | #6 of 12 | Official leaderboard | |
| Wer wird Millionär? LLM Benchmark | 3600.0 | #39 of 76 | Official leaderboard | |
| Lech Mazur Creative Writing | 7.70 | #23 of 44 | Epoch AI | |
| Longform Creative Writing (EQ-Bench) | 60.1 | #63 of 119 | Official leaderboard | |
| Creative Writing v3 | 65.8 | #67 of 120 | Official leaderboard | |
| WritingBench | 69.4 | #26 of 45 | Official leaderboard | |
| SimpleQA Verified | 27.4% | #35 of 56 | Official leaderboard | |
| EQ-Bench 3 | 1,124 | #49 of 78 | Official leaderboard | |
| Phare | 62.2% | #44 of 62 | Official leaderboard | |
| Fiction.LiveBench | 50% | #42 of 57 | Epoch AI | |
| LLM Confabulation Leaderboard | 26.1% | #49 of 58 | Official leaderboard | |
| FACTS Grounding | 63.9% | #29 of 34 | Official leaderboard |
Math and science
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MATH Level 5 | 75.5% | #30 of 94 | Epoch AI | |
| Misguided Attention | 53.5% | #15 of 45 | Official leaderboard | |
| ForecastBench | 62.4 | #40 of 86 | Official leaderboard | |
| GPQA Diamond | 67.6% | #112 of 219 | Epoch AI | |
| PolyMath | 30.7% | #20 of 38 | Official leaderboard | |
| HiPhO | 45.7% | #22 of 35 | Official leaderboard | |
| OTIS Mock AIME 2024-2025 | 37.8% | #132 of 202 | Epoch AI | |
| DTBench | 41.3% | #124 of 178 | Official leaderboard | |
| CORE-Bench | 17.8% | #13 of 17 | Official leaderboard | |
| CritPt | 0% | #129 of 160 | Epoch AI | |
| SimpleBench | 27.2% | #81 of 100 | Official leaderboard | |
| AIME 2025 | 50% | #45 of 53 | Official leaderboard | |
| PHYBench | 13.6% | #24 of 28 | Official leaderboard | |
| HMMT 2025 | 29.2% | #47 of 53 | Official leaderboard | |
| AMO-Bench | 5.20% | #19 of 21 | Official leaderboard | |
| PutnamBench | 0% | #13 of 14 | Official leaderboard |
Coding
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| BigCodeBench-Hard | 31.8% | #13 of 96 | Official leaderboard | |
| AutoCodeBench | 48.1% | #8 of 34 | Official leaderboard | |
| SWE-bench Lite | 36.7% | #6 of 15 | Official leaderboard | |
| Aider Polyglot | 55.1% | #22 of 54 | Epoch AI | |
| METR Time Horizon | 25 min | #17 of 31 | Official leaderboard | |
| BigO(Bench) | 34.2% | #10 of 18 | Official leaderboard | |
| BIRD-CRITIC | 24.5% | #5 of 9 | Official leaderboard | |
| SWE-bench Verified | 42% | #40 of 60 | Official leaderboard | |
| LiveSQLBench | 19.8% | #27 of 36 | Official leaderboard | |
| WeirdML | 36.1% | #98 of 130 | Epoch AI | |
| ArtifactsBench | 43.5% | #16 of 20 | Official leaderboard | |
| SWE-bench-Live | 15.3% | #12 of 13 | Official leaderboard | |
| IOI (Vals) | 1.67% | #51 of 55 | Official leaderboard |
Agents and tools
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| Berkeley Function Calling Leaderboard (BFCL) | 64.7% | #15 of 67 | Official leaderboard | |
| Galileo Agent Leaderboard | 0.91 | #8 of 31 | Official leaderboard | |
| ToolComp | 64.2% | #9 of 32 | Official leaderboard | |
| Galileo Agent Leaderboard v2 | 40% | #12 of 21 | Official leaderboard | |
| SnakeBench | 21 | #122 of 183 | Official leaderboard | |
| LLM Chess | -579 | #113 of 124 | Official leaderboard | |
| AgentBench FC | 36.1% | #11 of 12 | Official leaderboard | |
| MCP-Universe | 14.3% | #30 of 30 | Official leaderboard |
Professional work
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| LEXam | 52.5% | #12 of 31 | Official leaderboard | |
| LegalBench | 80.8% | #80 of 138 | Official leaderboard | |
| TaxEval v2 | 71.1% | #78 of 129 | Official leaderboard | |
| CorpFin v2 | 54.7% | #85 of 119 | Official leaderboard | |
| StockBench | 0.20% | #10 of 13 | Official leaderboard |
Safety and security
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| BaxBench | 30.5% | #17 of 34 | Official leaderboard | |
| Anthropic Red Team | 97.1% | #58 of 75 | Official leaderboard | |
| HELM Safety | 87.2 | #60 of 75 | Official leaderboard | |
| SimpleSafetyTests | 95.3% | #64 of 75 | Official leaderboard | |
| CyberGym | 3.58% | #29 of 33 | Official leaderboard | |
| AIR-Bench 2024 | 40.8% | #75 of 82 | Official leaderboard |
Other
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| HELM Lite | 90.8 | #3 of 71 | Official leaderboard | |
| LiveBench | 66.9% | #10 of 48 | Epoch AI | |
| HELM Capabilities | 66.5 | #29 of 60 | Official leaderboard | |
| Conceptual Reasoning Index | 26.2 | #121 of 149 | Official leaderboard | |
| ACCoRD | 43.4 | #124 of 150 | Official leaderboard | |
| LMCA | 15.5% | #118 of 139 | Epoch AI |
DeepSeek's models over time
DeepSeek's models in color, against every other model on the Epoch Capabilities Index, by release date.