- AIME2024 (Math) 73.3
- GPQA Diamond (Science) 74.2
- MMMU (Multimodal reasoning) 75.4
Gemini 2.0 Flash Thinking Jan 2025
Gemini 2.0 Flash Thinking places in the top three on 2 benchmarks.
Google DeepMind Released 21 Jan 2025 33
Benchmarks with a score
0
Ranked first, out of five or more models
2
In the top three
Google DeepMind Jan 2025 Gemini 2.0 Flash Thinking
Jan 2025 snapshot Closed weights
135.3
#145 of 271
Epoch Capabilities Index
- Humanity's Last Exam 6.56% #38 /47
- ZeroBench 5.00% #41 /66
- GPQA Diamond 57.1% #130 /219
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| LLM Confabulation Leaderboard | 12.4% | #10 of 58 | Official leaderboard | |
| SEAL Multilingual | 1,108 | #4 of 19 | Official leaderboard | |
| LongBench v2 | 56% | #9 of 33 | Official leaderboard | |
| Lech Mazur Creative Writing | 7.38 | #30 of 44 | Epoch AI | |
| Fiction.LiveBench | 52.8% | #39 of 57 | Epoch AI | |
| Humanity's Last Exam | 6.56% | #38 of 47 | Official leaderboard | |
| Vectara Hallucination Leaderboard (HHEM) | 1.80% | #133 of 148 | Official leaderboard |
Math and science
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| U-MATH | 83.6% | #2 of 30 | Official leaderboard | |
| PolyMath | 37.1% | #14 of 38 | Official leaderboard | |
| OTIS Mock AIME 2024-2025 | 57.8% | #117 of 202 | Epoch AI | |
| GPQA Diamond | 57.1% | #130 of 219 | Epoch AI | |
| USAMO 2025 | 4.17% | #6 of 10 | Official leaderboard | |
| AIME 2024 | 73.3% | #54 of 87 | Model card | |
| PutnamBench | 0.15% | #9 of 14 | Official leaderboard | |
| PHYBench | 18.2% | #19 of 28 | Official leaderboard | |
| SimpleBench | 30.7% | #78 of 100 | Official leaderboard | |
| HMMT 2025 | 35.8% | #42 of 53 | Official leaderboard | |
| AIME 2025 | 53.3% | #44 of 53 | Official leaderboard |
Coding
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| SEAL Coding | 1,108 | #6 of 26 | Official leaderboard | |
| BigCodeBench-Hard | 27% | #32 of 96 | Official leaderboard | |
| Aider Polyglot | 18.2% | #44 of 54 | Epoch AI |
Agents and tools
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| ToolComp | 63.2% | #11 of 32 | Official leaderboard | |
| Berkeley Function Calling Leaderboard (BFCL) | 58.7% | #26 of 67 | Official leaderboard | |
| Step Race | 2 | #30 of 59 | Official leaderboard | |
| Elimination Game | 3 | #49 of 56 | Official leaderboard |
Professional work
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| TaxEval v2 | 69.8% | #89 of 129 | Official leaderboard |
Vision, audio and robotics
Other
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| LiveBench | 66.9% | #9 of 48 | Epoch AI |
Google DeepMind's models over time
Google DeepMind's models in color, against every other model on the Epoch Capabilities Index, by release date.
Its launch post
The benchmarks the lab chose to headline, with the scores it gave.