Benchmark Almanac

Phi-4-reasoning

Phi-4-reasoning places in the top three on HumanEval+.

Microsoft Released 30 Apr 2025 Family Phi-4 The lab's model card
20
Benchmarks with a score
0
Ranked first, out of five or more models
1
In the top three
Microsoft Apr 2025

Phi-4-reasoning

Open weights Small

No Epoch Capabilities Index score yet
  • MMLU-Pro 74.3% #103 /151
  • AIME 2025 63.1% #122 /143
  • IFEval 83.4% #86 /126

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
Arena-Hard-Auto 73.3% #24 of 39 Model card
MMLU-Pro 74.3% #103 of 151 Model card
IFEval 83.4% #86 of 126 Model card
FlenQA 97.7% #2 of 2 Model card

Math and science

BenchmarkScoreRankSource
3SAT-Search 78% #1 of 2 Model card
BA-Calendar 67.7% #1 of 2 Model card
AIME 2024 75.3% #52 of 87 Model card
GPQA Diamond 67.1% #182 of 284 Model card
Omni-MATH 76.6% #3 of 4 Model card
AIME 2025 63.1% #122 of 143 Model card
HMMT 2025 43.8% #48 of 49 Model card
AIME 1983-2024 83.1% #2 of 2 Model card
TSP-Opt 37.5% #2 of 2 Model card

Coding

BenchmarkScoreRankSource
HumanEval+ 92.9% #3 of 27 Model card
LiveCodeBench 53.8% #38 of 73 Model card
Codeforces rating 1,736 #31 of 41 Model card

Vision, audio and robotics

BenchmarkScoreRankSource
SpatialEval Maze-Nav 55.1% #1 of 2 Model card
SpatialEval Spatial-Map 73.7% #1 of 2 Model card

Safety and security

BenchmarkScoreRankSource
ToxiGen (discriminative) 85.5% #1 of 2 Model card

Other

BenchmarkScoreRankSource
PhiBench 70.6% #2 of 3 Model card

Its launch post

The benchmarks the lab chose to headline, with the scores it gave.

Its system card

Every result in the longer documents the lab published with it. 9 of them aren't in the launch post.