Benchmark Almanac

Gemini 2.5 Flash-Lite Sep 2025

Gemini 2.5 Flash-Lite places in the top three on Vectara Hallucination Leaderboard (2025 dataset).

Google DeepMind Released 25 Sep 2025
36
Benchmarks with a score
0
Ranked first, out of five or more models
1
In the top three
Google DeepMind Sep 2025

Gemini 2.5 Flash-Lite

Sep 2025 snapshot Closed weights

No Epoch Capabilities Index score yet
  • LiveCodeBench v5 58.4% #30 /44
  • CorpFin v2 57.6% #82 /119
  • TaxEval v2 66.2% #104 /129

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
Vectara Hallucination Leaderboard (2025 dataset) 3.30% #2 of 104 Official leaderboard
FACTS Grounding 87.5% #4 of 15 Model card
HELM Arabic 79.5 #10 of 28 Official leaderboard
Global MMLU Lite 84.9% #7 of 16 Model card
LMArena (Elo) 1,379 #152 of 333 Official leaderboard
HELM Arabic Enterprise 62.6 #16 of 23 Official leaderboard
Phare 58.9% #52 of 62 Official leaderboard
Judgemark v2.1 56.0 #36 of 42 Official leaderboard
Humanity's Last Exam 7.30% #142 of 147 Model card
MRCR v2 25.6% #27 of 27 Model card
SimpleQA Verified 9.60% #22 of 22 Model card

Math and science

BenchmarkScoreRankSource
GPQA Diamond 71.7% #158 of 284 Model card
AIME 2025 48.2% #133 of 143 Model card

Coding

BenchmarkScoreRankSource
LiveCodeBench v5 58.4% #30 of 44 Model card
SWE-bench Verified 38.9% #141 of 150 Model card

Agents and tools

BenchmarkScoreRankSource
SnakeBench 25 #73 of 183 Official leaderboard
BFCL V4 36.9% #33 of 65 Official leaderboard
PinchBench 11.8% #48 of 48 Official leaderboard

Professional work

BenchmarkScoreRankSource
LegalBench 82% #75 of 138 Official leaderboard
CorpFin v2 57.6% #82 of 119 Official leaderboard
MedScribe 75.8% #72 of 98 Official leaderboard
MedCode 34.2% #75 of 96 Official leaderboard
MortgageTax 57.5% #69 of 86 Official leaderboard
TaxEval v2 66.2% #104 of 129 Official leaderboard

Vision, audio and robotics

BenchmarkScoreRankSource
MMMU 72% #52 of 97 Model card
RoboRewardBench 0.99 #12 of 19 Official leaderboard
MMAU v05.15.25 66.2% #6 of 9 Official leaderboard
Vision Arena 1,175 #91 of 136 Official leaderboard
Vibe-Eval 59.8% #7 of 9 Model card
VPCT 30% #28 of 28 Epoch AI

Safety and security

BenchmarkScoreRankSource
AIR-Bench 2024 65.8% #42 of 82 Official leaderboard
HELM Safety 91.0 #40 of 75 Official leaderboard
Anthropic Red Team 98.7% #45 of 75 Official leaderboard
SimpleSafetyTests 96.5% #61 of 75 Official leaderboard

Other

BenchmarkScoreRankSource
HELM Capabilities 59.1 #44 of 60 Official leaderboard
SAGE (Vals) 30.8% #74 of 81 Official leaderboard

Its launch post

The benchmarks the lab chose to headline, with the scores it gave.