Benchmark Almanac

Grok-2 mini

Grok-2 mini.

xAI Released 13 Aug 2024 Family Grok 2 The lab's model card
4
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
xAI Aug 2024

Grok-2 mini

Closed weights Mid-size

No Epoch Capabilities Index score yet

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
MMLU-Pro 71.8% #81 of 212 Official leaderboard
LMArena (Elo) 1,308 #219 of 333 Official leaderboard

Coding

BenchmarkScoreRankSource
Aider-Edit 54.9% #29 of 37 Official leaderboard

Vision, audio and robotics

BenchmarkScoreRankSource
MathVista 68.1% #11 of 43 Official leaderboard