Introducing GPT-4.1 in the API 14 Apr 2025
- SWE-bench Verified (477/500) 54.6
- Aider's polyglot: diff 52.9
- MultiChallenge 38.3
- IFEval 87.4
- Best of OpenAI-MRCR: 2 needle 128k / OpenAI-MRCR: 2 needle 1M 57.2
- Best of Graphwalks bfs <128k / Graphwalks bfs >128k / Graphwalks parents <128k / Graphwalks parents >128k 61.7
- Video-MME (long, no subtitles) 72
- MMMU 74.8
- MathVista 72.2
- CharXiv-R 56.7