GPT-4.1 nano

GPT-4.1 nano.

OpenAI Released 14 Apr 2025

Benchmarks with a score

Ranked first, out of five or more models

In the top three

OpenAI Apr 2025

Closed weights

129.6 #163 of 271

Epoch Capabilities Index

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Benchmark	Score	Rank	Source
MMLU	80.1%	#75 of 127	Model card
LMArena (Elo)	1,322	#205 of 333	Official leaderboard
Wer wird Millionär? LLM Benchmark	389.0	#51 of 76	Official leaderboard
EQ-Bench 3	1,050	#61 of 78	Official leaderboard
MMBench-CN v1.1	60.4%	#140 of 178	Official leaderboard
Vectara Hallucination Leaderboard (HHEM)	2.00%	#126 of 148	Official leaderboard
HELM Arabic	70.2	#24 of 28	Official leaderboard
MMMLU	66.9%	#54 of 62	Model card
Creative Writing v3	50.9	#105 of 120	Official leaderboard
IFEval	74.5%	#112 of 126	Model card
Multi-IF	57.2%	#25 of 28	Model card
OpenAI MRCR	36.6%	#9 of 10	Model card
RewardBench 2	48.5%	#38 of 42	Official leaderboard
Arena-Hard v2.0	13.7%	#21 of 23	Official leaderboard
Longform Creative Writing (EQ-Bench)	32.4	#109 of 119	Official leaderboard
Phare	57.5%	#58 of 62	Official leaderboard
Fiction.LiveBench	25%	#56 of 57	Epoch AI
SimpleQA Verified	6.00%	#84 of 84	Epoch AI
MultiChallenge	15%	#36 of 36	Model card
GraphWalks	25%	#21 of 21	Model card
COLLIE	42.5%	#12 of 12	Model card
Internal API instruction following (OpenAI)	31.6%	#4 of 4	Model card

Benchmark	Score	Rank	Source
MATH Level 5	70%	#34 of 94	Epoch AI
OTIS Mock AIME 2024-2025	28.9%	#138 of 202	Epoch AI
GPQA Diamond	48.9%	#150 of 219	Epoch AI
CritPt	0%	#133 of 160	Epoch AI
FrontierMath	1.03%	#61 of 70	Epoch AI
DTBench	20.9%	#156 of 178	Official leaderboard
Misguided Attention	26.6%	#40 of 45	Official leaderboard
AIME 2024	29.4%	#79 of 87	Model card
ARC-AGI-2	0%	#93 of 95	Official leaderboard
ARC-AGI	0%	#92 of 92	Official leaderboard

Benchmark	Score	Rank	Source
BigCodeBench-Hard	30.1%	#21 of 96	Official leaderboard
WeirdML	19%	#103 of 112	Official leaderboard
Aider Polyglot	8.90%	#52 of 54	Epoch AI

Benchmark	Score	Rank	Source
BFCL V4	33%	#35 of 65	Official leaderboard
Galileo Agent Leaderboard v2	38%	#13 of 21	Official leaderboard
Berkeley Function Calling Leaderboard (BFCL)	53%	#42 of 67	Official leaderboard
Galileo Agent Leaderboard	0.80	#24 of 31	Official leaderboard
SnakeBench	16	#161 of 183	Official leaderboard
LisanBench	54.0	#121 of 133	Official leaderboard
Chess Puzzles	0%	#83 of 83	Epoch AI
MCPMark	0%	#28 of 28	Official leaderboard
tau-bench	18.3%	#23 of 23	Model card
ComplexFuncBench	5.70%	#3 of 3	Model card

Benchmark	Score	Rank	Source
LEXam	43.7%	#18 of 31	Official leaderboard
MortgageTax	52.8%	#73 of 86	Official leaderboard
TaxEval v2	60.8%	#113 of 129	Official leaderboard
CorpFin v2	42.1%	#109 of 119	Official leaderboard
LegalBench	61.1%	#130 of 138	Official leaderboard
ProfBench	33.2%	#70 of 72	Official leaderboard
Vals Finance Agent v1	2.47%	#46 of 47	Official leaderboard

Benchmark	Score	Rank	Source
A-Bench	72.9%	#52 of 116	Official leaderboard
MMStar	47.5%	#115 of 173	Official leaderboard
CCBench (MMBench Chinese Culture)	31.2%	#106 of 152	Official leaderboard
MMBench	68.2%	#120 of 155	Official leaderboard
MMBench-EN v1.1	64.4%	#147 of 178	Official leaderboard
Math-VR	9.10%	#22 of 26	Official leaderboard
VHELM	29.1	#35 of 41	Official leaderboard
Vision Arena	1,089	#117 of 136	Official leaderboard
MathVista	56.2%	#56 of 64	Model card
MMMU	55.4%	#85 of 97	Model card
VISTA	26.6%	#48 of 54	Official leaderboard
CharXiv	40.5%	#67 of 67	Model card
MADQA	19.5%	#16 of 16	Official leaderboard

Benchmark	Score	Rank	Source
Anthropic Red Team	99.6%	#14 of 75	Official leaderboard
HELM Safety	93.8	#28 of 75	Official leaderboard
SimpleSafetyTests	99%	#36 of 75	Official leaderboard
AIR-Bench 2024	61.5%	#51 of 82	Official leaderboard

Benchmark	Score	Rank	Source
OpenVLM Leaderboard	57.5	#96 of 173	Official leaderboard
HELM Capabilities	61.6	#39 of 60	Official leaderboard
Conceptual Reasoning Index	12.3	#142 of 149	Official leaderboard
ACCoRD	24.3	#143 of 150	Official leaderboard
LMCA	5.46%	#135 of 139	Epoch AI

OpenAI's models in color, against every other model on the Epoch Capabilities Index, by release date.

The benchmarks the lab chose to headline, with the scores it gave.