- Humanity's Last Exam (no tools), Preview Thinking (09-2025) 7.3
- GPQA diamond, Thinking 71.7
- AIME 2025, Thinking (non-thinking 50.1) 48.2
- LiveCodeBench v5 (UI: 1/1/2025-5/1/2025), Thinking 58.4
- SWE-Bench Verified single attempt, Thinking (non-thinking 41.3) 38.9
- SimpleQA Verified, Thinking 9.6
- FACTS Grounding, Thinking 87.5
- MMMU single attempt, Thinking 72
- Vibe-Eval (Reka), Thinking 59.8
- MRCR v2 (8-needle) 128k (average), Thinking (1M pointwise 7.7) 25.6
- Global MMLU (Lite), Thinking 84.9
Gemini 2.5 Flash-Lite Sep 2025
Gemini 2.5 Flash-Lite places in the top three on Vectara Hallucination Leaderboard (2025 dataset).
36
Benchmarks with a score
0
Ranked first, out of five or more models
1
In the top three
Gemini 2.5 Flash-Lite
Sep 2025 snapshot Closed weights
No Epoch Capabilities Index score yet
- LiveCodeBench v5 58.4% #30 /44
- CorpFin v2 57.6% #82 /119
- TaxEval v2 66.2% #104 /129
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| Vectara Hallucination Leaderboard (2025 dataset) | 3.30% | #2 of 104 | Official leaderboard | |
| FACTS Grounding | 87.5% | #4 of 15 | Model card | |
| HELM Arabic | 79.5 | #10 of 28 | Official leaderboard | |
| Global MMLU Lite | 84.9% | #7 of 16 | Model card | |
| LMArena (Elo) | 1,379 | #152 of 333 | Official leaderboard | |
| HELM Arabic Enterprise | 62.6 | #16 of 23 | Official leaderboard | |
| Phare | 58.9% | #52 of 62 | Official leaderboard | |
| Judgemark v2.1 | 56.0 | #36 of 42 | Official leaderboard | |
| Humanity's Last Exam | 7.30% | #142 of 147 | Model card | |
| MRCR v2 | 25.6% | #27 of 27 | Model card | |
| SimpleQA Verified | 9.60% | #22 of 22 | Model card |
Math and science
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| GPQA Diamond | 71.7% | #158 of 284 | Model card | |
| AIME 2025 | 48.2% | #133 of 143 | Model card |
Coding
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| LiveCodeBench v5 | 58.4% | #30 of 44 | Model card | |
| SWE-bench Verified | 38.9% | #141 of 150 | Model card |
Agents and tools
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| SnakeBench | 25 | #73 of 183 | Official leaderboard | |
| BFCL V4 | 36.9% | #33 of 65 | Official leaderboard | |
| PinchBench | 11.8% | #48 of 48 | Official leaderboard |
Professional work
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| LegalBench | 82% | #75 of 138 | Official leaderboard | |
| CorpFin v2 | 57.6% | #82 of 119 | Official leaderboard | |
| MedScribe | 75.8% | #72 of 98 | Official leaderboard | |
| MedCode | 34.2% | #75 of 96 | Official leaderboard | |
| MortgageTax | 57.5% | #69 of 86 | Official leaderboard | |
| TaxEval v2 | 66.2% | #104 of 129 | Official leaderboard |
Vision, audio and robotics
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MMMU | 72% | #52 of 97 | Model card | |
| RoboRewardBench | 0.99 | #12 of 19 | Official leaderboard | |
| MMAU v05.15.25 | 66.2% | #6 of 9 | Official leaderboard | |
| Vision Arena | 1,175 | #91 of 136 | Official leaderboard | |
| Vibe-Eval | 59.8% | #7 of 9 | Model card | |
| VPCT | 30% | #28 of 28 | Epoch AI |
Safety and security
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| AIR-Bench 2024 | 65.8% | #42 of 82 | Official leaderboard | |
| HELM Safety | 91.0 | #40 of 75 | Official leaderboard | |
| Anthropic Red Team | 98.7% | #45 of 75 | Official leaderboard | |
| SimpleSafetyTests | 96.5% | #61 of 75 | Official leaderboard |
Other
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| HELM Capabilities | 59.1 | #44 of 60 | Official leaderboard | |
| SAGE (Vals) | 30.8% | #74 of 81 | Official leaderboard |
Its launch post
The benchmarks the lab chose to headline, with the scores it gave.