Benchmark Almanac

Phi-1.5

Phi-1.5.

Microsoft Released 11 Sep 2023
7
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Microsoft Sep 2023

Phi-1.5

Open weights

91.4 #262 of 271
Epoch Capabilities Index

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
WinoGrande 73.4% #38 of 76 Epoch AI
BoolQ 75.8% #49 of 75 Epoch AI
ARC-Challenge 44.4% #53 of 75 Epoch AI
OpenBookQA 37.2% #36 of 41 Epoch AI
MMLU 37.6% #113 of 127 Epoch AI
HellaSwag 47.6% #69 of 74 Epoch AI

Coding

BenchmarkScoreRankSource
CRUXEval 27.5% #11 of 11 Official leaderboard

Microsoft's models over time

Microsoft's models in color, against every other model on the Epoch Capabilities Index, by release date.

50 75 100 125 150 175 2023 2024 2025 2026 2027 Phi-4 phi-3-medium 14B Phi-2 Phi-1.5 50 75 100 125 150 175 2023 2024 2025 2026 2027 Phi-4 phi-3-medium 14B