Benchmark Almanac

GPT-4o Jan 2025

GPT-4o.

OpenAI Released 29 Jan 2025
6
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
OpenAI Jan 2025

GPT-4o

Jan 2025 snapshot Closed weights

No Epoch Capabilities Index score yet
  • Misguided Attention 32.1% #33 /45
  • Aider Polyglot 27.1% #39 /54
  • Fiction.LiveBench 66.7% #22 /57

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
BIG-Bench Extra Hard 22.3% #4 of 11 Official leaderboard
Fiction.LiveBench 66.7% #22 of 57 Epoch AI
Creative Writing v3 63.0 #76 of 120 Official leaderboard

Math and science

BenchmarkScoreRankSource
Misguided Attention 32.1% #33 of 45 Official leaderboard

Coding

BenchmarkScoreRankSource
Aider Polyglot 27.1% #39 of 54 Epoch AI

Vision, audio and robotics

BenchmarkScoreRankSource
GeoBench 71% #27 of 48 Official leaderboard