Introducing GPT-5 for developers (OpenAI) 7 Aug 2025
- AIME '25 (no tools) 85.2
- FrontierMath (with python tool only) 9.6
- GPQA diamond (no tools) 71.2
- HLE (no tools) 8.7
- HMMT 2025 (no tools) 75.6
- MMMU 75.6
- MMMU-Pro (avg across standard and vision sets) 62.6
- CharXiv reasoning (python enabled) 62.7
- VideoMMMU, max frame 256 66.8
- ERQA 50.1
- SWE-Lancer: IC SWE Diamond Freelance Coding Tasks ($49K) 49000
- SWE-bench Verified (477 of 500 tasks) 54.7
- Aider polyglot (diff) 48.4
- Scale MultiChallenge (o3-mini grader) 54.9
- Internal API instruction following eval (hard) 56.1
- COLLIE 96.9
- Mean of Tau2-bench airline 41.0 / retail 62.3 / telecom 35.5 46.3
- OpenAI-MRCR: 2 needle 128k 43.2
- Graphwalks bfs <128k 64.0 (parents <128k 43.8) 64
- BrowseComp Long Context 128k 80.4 (256k 68.4) 80.4
- VideoMME (long, with subtitle category) 65.7
- Best of LongFact-Concepts / LongFact-Objects hallucination rate, no tools (lower is better) Concepts 1.0, Objects 2.8 1
- FActScore hallucination rate, no tools (lower is better) 7.3