Qwen2.5-Max

Qwen2.5-Max.

Qwen Released 25 Jan 2025 Family Qwen2.5 The lab's model card

Benchmarks with a score

Ranked first, out of five or more models

In the top three

Qwen Jan 2025

Closed weights Flagship

132.5 #154 of 271

Epoch Capabilities Index

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Benchmark	Score	Rank	Source
MMLU-Pro	76.1%	#70 of 212	Official leaderboard
SuperGPQA	50.1%	#21 of 58	Official leaderboard
Fiction.LiveBench	66.7%	#21 of 57	Epoch AI
LMArena (Elo)	1,374	#157 of 333	Official leaderboard
LLM Confabulation Leaderboard	21.8%	#42 of 58	Official leaderboard
Phare	62.2%	#45 of 62	Official leaderboard
Vectara Hallucination Leaderboard (HHEM)	2.90%	#109 of 148	Official leaderboard
Lech Mazur Creative Writing	7.29	#34 of 44	Epoch AI

Benchmark	Score	Rank	Source
MATH Level 5	67.2%	#36 of 94	Epoch AI
GPQA Diamond	56.1%	#133 of 219	Epoch AI
OTIS Mock AIME 2024-2025	16.1%	#148 of 202	Epoch AI
Misguided Attention	31.4%	#34 of 45	Official leaderboard
FrontierMath	1.03%	#60 of 70	Epoch AI
PolyMath	19.4%	#34 of 38	Official leaderboard
PHYBench	6.27%	#28 of 28	Official leaderboard

Benchmark	Score		Rank	Source
BigCodeBench-Hard	32.5%		#9 of 96	Official leaderboard
Aider Polyglot	21.8%		#41 of 54	Epoch AI

Benchmark	Score		Rank	Source
Step Race	1		#38 of 59	Official leaderboard
Elimination Game	2		#51 of 56	Official leaderboard

Benchmark	Score		Rank	Source
LiveBench	62.3%		#13 of 48	Epoch AI

Qwen's models in color, against every other model on the Epoch Capabilities Index, by release date.

The benchmarks the lab chose to headline, with the scores it gave.