Benchmark Almanac

GPT-4o Mar 2025

GPT-4o places in the top three on 3 benchmarks.

OpenAI Released 27 Mar 2025
52
Benchmarks with a score
0
Ranked first, out of five or more models
3
In the top three
OpenAI Mar 2025

GPT-4o

Mar 2025 snapshot Closed weights

No Epoch Capabilities Index score yet
  • ZeroBench 0% #65 /66
  • OCRBench v2 47.6% #21 /65
  • HiPhO 32.1% #26 /35

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
BuzzBench 69.1 #2 of 23 Official leaderboard
MMBench-CN v1.1 85.2% #16 of 178 Official leaderboard
EQ-Bench v2 83.5 #10 of 85 Official leaderboard
ECLeKTic 29.9% #7 of 35 Official leaderboard
LMArena (Elo) 1,443 #71 of 333 Official leaderboard
Phare 70.7% #17 of 62 Official leaderboard
MultiLoKo 31% #2 of 7 Official leaderboard
EQ-Bench 3 1,419 #31 of 78 Official leaderboard
Wer wird Millionär? LLM Benchmark 12622.0 #33 of 76 Official leaderboard
Creative Writing v3 68.8 #59 of 120 Official leaderboard
Longform Creative Writing (EQ-Bench) 60.2 #61 of 119 Official leaderboard
FACTS Grounding 75.9% #20 of 34 Official leaderboard
LLM Confabulation Leaderboard 20.8% #40 of 58 Official leaderboard
FACTS Search 56.8% #27 of 31 Official leaderboard
Vectara Hallucination Leaderboard (HHEM) 1.50% #137 of 148 Official leaderboard

Math and science

BenchmarkScoreRankSource
HiPhO 32.1% #26 of 35 Official leaderboard
PolyMath 24.3% #29 of 38 Official leaderboard
PHYBench 6.97% #27 of 28 Official leaderboard
AIME 2025 11.7% #52 of 53 Official leaderboard
HMMT 2025 5.83% #52 of 53 Official leaderboard
Verifying the Verifiers (Project APE CRED benchmark) 11.5% #23 of 23 Official leaderboard

Coding

BenchmarkScoreRankSource
SWT-bench 38% #3 of 9 Official leaderboard
Aider Polyglot 45.3% #30 of 54 Epoch AI
SWE-bench Multimodal 30.4% #6 of 9 Official leaderboard
BigO(Bench) 33.1% #13 of 18 Official leaderboard
LiveSQLBench 15.5% #30 of 36 Official leaderboard
SWE-bench Verified 21.6% #53 of 60 Official leaderboard
GSO-Bench 0% #30 of 30 Official leaderboard
ArtifactsBench 33.5% #20 of 20 Official leaderboard
SWE-bench-Live 11.7% #13 of 13 Official leaderboard

Agents and tools

BenchmarkScoreRankSource
Elimination Game 5 #7 of 56 Official leaderboard
LisanBench 302.7 #79 of 133 Official leaderboard
Pencil Puzzle Bench 0% #32 of 53 Official leaderboard
Step Race 2 #36 of 59 Official leaderboard
PinchBench 65.4% #32 of 48 Official leaderboard
Meta Agents Research Environments (ARE) / Gaia2 7.40% #11 of 13 Official leaderboard
OSWorld-Verified 29.3% #28 of 33 Official leaderboard
SnakeBench 9 #179 of 183 Official leaderboard

Professional work

BenchmarkScoreRankSource
LEXam 56.9% #8 of 31 Official leaderboard
xbench-Recruitment 38.9 #8 of 8 Official leaderboard
xbench-Marketing 32.0 #7 of 7 Official leaderboard

Vision, audio and robotics

BenchmarkScoreRankSource
MMBench-EN v1.1 86.8% #8 of 178 Official leaderboard
OCRBench v2 47.6% #21 of 65 Official leaderboard
Vision Arena 1,239 #57 of 136 Official leaderboard
ERQA 34.8% #10 of 17 Official leaderboard
VisuLogic 26.3% #10 of 17 Official leaderboard
Point-Bench 29.5% #13 of 17 Official leaderboard
ZeroBench 0% #65 of 66 Official leaderboard
Blueprint-Bench 0.13 #8 of 8 Official leaderboard

Safety and security

BenchmarkScoreRankSource
BaxBench 26.7% #18 of 34 Official leaderboard
KORA 23.6% #33 of 42 Official leaderboard
Virology Capabilities Test (VCT) 18.8% #7 of 7 Official leaderboard