Kimi k1.5

Kimi k1.5 ranks first on MME-CoT.

Moonshot AI Released 20 Jan 2025 Family Kimi k1.5 The lab's model card

Benchmarks with a score

Ranked first, out of five or more models

In the top three

Moonshot AI Jan 2025

Flagship

No Epoch Capabilities Index score yet

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Benchmark	Score	Rank	Source
CLUEWSC	91.7%	#2 of 8	Model card
MMLU	87.4%	#33 of 127	Model card
IFEval	87.2%	#55 of 126	Model card
C-Eval	88.3%	#21 of 38	Model card

Benchmark	Score		Rank	Source
MATH-500	96.2%		#31 of 67	Model card
AIME 2024	77.5%		#47 of 87	Model card

Benchmark	Score		Rank	Source
HumanEval Multi	81.5%		#2 of 5	Model card
LiveCodeBench	62.5%		#33 of 73	Model card

Benchmark	Score	Rank	Source
MME-CoT	64.2%	#1 of 11	Official leaderboard
MathVista	74.9%	#31 of 64	Model card
MMMU	70%	#59 of 97	Model card
MATH-Vision (MathVision)	38.6%	#38 of 42	Model card

The benchmarks the lab chose to headline, with the scores it gave.

Every result in the longer documents the lab published with it.