- MMLU-Pro 77.6
- LiveCodeBench (v5) (UI 10/01/2024-02/01/2025) 34.5
- Bird-SQL (Dev) 58.7
- GPQA (diamond) 60.1
- SimpleQA 29.9
- FACTS Grounding 84.6
- Global MMLU (Lite) 83.4
- MATH 90.9
- HiddenMath 63.5
- MRCR (1M) 70.5
- MMMU 71.7
- CoVoST2 (21 lang), BLEU 39
- EgoSchema (test) 71.1
Gemini 2.0 Flash Feb 2025
Gemini 2.0 Flash ranks first on KRETA.
Google DeepMind Released 5 Feb 2025 86
Benchmarks with a score
1
Ranked first, out of five or more models
8
In the top three
Google DeepMind Feb 2025 Gemini 2.0 Flash
Feb 2025 snapshot Closed weights
134.7
#148 of 271
Epoch Capabilities Index
- MultiChallenge 36.4% #35 /35
- ZeroBench 3.00% #47 /66
- GPQA Diamond 64.1% #122 /219
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| FaithJudge | 10.2% | #5 of 37 | Official leaderboard | |
| ECLeKTic | 24.6% | #9 of 35 | Official leaderboard | |
| BIG-Bench Extra Hard | 23.9% | #3 of 11 | Official leaderboard | |
| BuzzBench | 54.4 | #8 of 23 | Official leaderboard | |
| SimpleQA | 29.9% | #24 of 59 | Model card | |
| MultiLoKo | 30.6% | #3 of 7 | Official leaderboard | |
| SuperGPQA | 47.7% | #25 of 58 | Official leaderboard | |
| MRCR (Michelangelo, original) | 70.5% | #4 of 9 | Model card | |
| FACTS Grounding | 84.6% | #7 of 15 | Model card | |
| LMArena (Elo) | 1,360 | #166 of 333 | Official leaderboard | |
| Fiction.LiveBench | 61.1% | #32 of 57 | Epoch AI | |
| Global MMLU Lite | 83.4% | #9 of 16 | Model card | |
| MMLU-Pro | 77.6% | #88 of 151 | Model card | |
| Phare | 64.2% | #37 of 62 | Official leaderboard | |
| WritingBench | 66.8 | #29 of 45 | Official leaderboard | |
| Creative Writing v3 | 57.0 | #91 of 120 | Official leaderboard | |
| BullshitBench V2 | 15% | #96 of 122 | Official leaderboard | |
| EQ-Bench 3 | 958 | #65 of 78 | Official leaderboard | |
| BullshitBench | 12.7% | #91 of 107 | Official leaderboard | |
| LLM Confabulation Leaderboard | 26.9% | #50 of 58 | Official leaderboard | |
| Vectara Hallucination Leaderboard (HHEM) | 0.70% | #148 of 148 | Official leaderboard | |
| MultiChallenge | 36.4% | #35 of 35 | Official leaderboard |
Math and science
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MATH | 90.9% | #8 of 93 | Model card | |
| HiddenMath | 63.5% | #3 of 11 | Model card | |
| MATH Level 5 | 82.2% | #26 of 94 | Epoch AI | |
| GPQA Diamond | 64.1% | #122 of 219 | Epoch AI | |
| OTIS Mock AIME 2024-2025 | 31.1% | #135 of 202 | Epoch AI | |
| DTBench | 38.7% | #127 of 178 | Official leaderboard | |
| ARC-AGI-2 | 1.30% | #76 of 94 | Epoch AI | |
| FrontierMath | 1.72% | #57 of 70 | Epoch AI | |
| Misguided Attention | 28.2% | #37 of 45 | Official leaderboard | |
| CORE-Bench | 11.1% | #14 of 17 | Official leaderboard | |
| AIME 2025 | 27.5% | #49 of 53 | Official leaderboard | |
| HMMT 2025 | 13.3% | #49 of 53 | Official leaderboard |
Coding
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| BigCodeBench-Hard | 28.7% | #25 of 96 | Official leaderboard | |
| Bird-SQL | 58.7% | #5 of 13 | Model card | |
| WeirdML | 25.8% | #109 of 130 | Epoch AI | |
| LiveCodeBench v5 | 34.5% | #37 of 44 | Model card | |
| StructEval | 62.5% | #24 of 28 | Official leaderboard | |
| SWE-bench Verified | 13.5% | #56 of 60 | Official leaderboard |
Agents and tools
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| SnakeBench | 33 | #16 of 183 | Official leaderboard | |
| Galileo Agent Leaderboard | 0.94 | #3 of 31 | Official leaderboard | |
| Berkeley Function Calling Leaderboard (BFCL) | 61.2% | #22 of 67 | Official leaderboard | |
| Factorio Learning Environment | 115782.0 | #2 of 6 | Official leaderboard | |
| ToolComp | 55.6% | #18 of 32 | Official leaderboard | |
| VideoGameBench | 0% | #3 of 5 | Official leaderboard | |
| LisanBench | 197.7 | #89 of 133 | Official leaderboard | |
| LLM Chess | -311 | #103 of 124 | Official leaderboard | |
| GAIA | 6.31% | #52 of 57 | Official leaderboard | |
| Elimination Game | 2 | #54 of 56 | Official leaderboard |
Professional work
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| TheAgentCompany | 11.4% | #7 of 14 | Epoch AI | |
| LegalBench | 78.4% | #95 of 138 | Official leaderboard | |
| MortgageTax | 60.4% | #62 of 86 | Official leaderboard | |
| CadEval | 30% | #11 of 15 | Epoch AI | |
| TaxEval v2 | 67.7% | #96 of 129 | Official leaderboard | |
| MedHELM | 36.0 | #10 of 13 | Official leaderboard | |
| Vals Finance Agent v1 | 13.2% | #37 of 47 | Official leaderboard | |
| FailureSensorIQ | 55.8% | #19 of 24 | Official leaderboard | |
| CorpFin v2 | 33.7% | #118 of 119 | Official leaderboard |
Vision, audio and robotics
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| KRETA | 85.4% | #1 of 17 | Official leaderboard | |
| MathVista | 73.1% | #6 of 43 | Official leaderboard | |
| AHELM | 63.3 | #2 of 10 | Official leaderboard | |
| MMMU | 71.7% | #29 of 136 | Official leaderboard | |
| VHELM | 68.1 | #10 of 41 | Official leaderboard | |
| ERQA | 40.2% | #5 of 17 | Official leaderboard | |
| VisualPuzzles | 44.9% | #9 of 29 | Official leaderboard | |
| GeoBench | 77% | #17 of 48 | Official leaderboard | |
| MMAU v05.15.25 | 70.5% | #4 of 9 | Official leaderboard | |
| CoVoST2 | 39.0 | #5 of 11 | Model card | |
| Point-Bench | 47% | #9 of 17 | Official leaderboard | |
| MATH-Vision (MathVision) | 41.3% | #59 of 105 | Official leaderboard | |
| VISTA | 39.9% | #34 of 54 | Official leaderboard | |
| Math-VR | 20.6% | #17 of 26 | Official leaderboard | |
| Vision Arena | 1,172 | #92 of 136 | Official leaderboard | |
| ZeroBench | 3.00% | #47 of 66 | Official leaderboard | |
| EgoSchema | 71.1% | #9 of 12 | Model card | |
| EnigmaEval | 0.63% | #39 of 41 | Epoch AI |
Safety and security
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| Anthropic Red Team | 99.4% | #23 of 75 | Official leaderboard | |
| AIR-Bench 2024 | 66.2% | #41 of 82 | Official leaderboard | |
| HELM Safety | 91.0 | #41 of 75 | Official leaderboard | |
| SimpleSafetyTests | 98.5% | #45 of 75 | Official leaderboard | |
| BaxBench | 23.3% | #21 of 34 | Official leaderboard | |
| AgentDojo | 20.8% | #13 of 20 | Official leaderboard |
Other
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| HELM Lite | 81.3 | #12 of 71 | Official leaderboard | |
| LiveBench | 61.5% | #14 of 48 | Epoch AI | |
| HELM Capabilities | 67.9 | #25 of 60 | Official leaderboard |
Google DeepMind's models over time
Google DeepMind's models in color, against every other model on the Epoch Capabilities Index, by release date.
Its launch post
The benchmarks the lab chose to headline, with the scores it gave.
Its system card
Every result in the longer documents the lab published with it. 5 of them aren't in the launch post.
Gemini 2.0 Flash Model Card 15 Apr 2025
Capabilities
- MMLU-Pro 77.6
- LiveCodeBench v5 34.5
- Bird-SQL 58.7
- GPQA Diamond 60.1
- SimpleQA 29.9
- FACTS Grounding 84.6
- Global MMLU Lite 83.4
- MATH 90.9
- HiddenMath 63.5
- MRCR (Michelangelo, original) 70.5
- MMMU 71.7
- CoVoST2 39
- EgoSchema 71.1