Introducing GPT-5 7 Aug 2025
- AIME 2025 Competition math, GPT-5 pro (python) 100
- FrontierMath, Tier 1-3, GPT-5 pro (python) 32.1
- HMMT Harvard-MIT mathematics tournament, GPT-5 pro (python) 100
- GPQA Diamond, GPT-5 pro (python) 89.4
- Humanity's Last Exam (Full Set)*, GPT-5 pro (python + search with blocklist) 42
- SWE-bench Verified (n=477), GPT-5 with thinking 74.9
- Aider Polyglot Multi-language code editing 88
- Scale MultiChallenge** Multi-turn instruction following 69.6
- BrowseComp Agentic search & browsing 54.9
- COLLIE Instruction-following in freeform writing 99
- Mean of Tau2-bench Function calling (airline) / Tau2-bench Function calling (retail) / Tau2-bench Function calling (telecom) 80.1
- MMMU College-level visual problem-solving 84.2
- MMMU Pro*** Graduate-level visual problem-solving 78.4
- VideoMMMU Video-based multimodal reasoning (max frame 256) 84.6
- CharXiv-Reasoning Scientific figure reasoning 81.1
- ERQA Multimodal spatial reasoning 65.7
- HealthBench Realistic health conversations 67.2
- HealthBench Hard Challenging health conversations 46.2
- HealthBench Hard Hallucinations (lower is better) 1.6
- Best of Hallucination rate on open-source prompts: LongFact-Concepts (lower is better) / Hallucination rate on open-source prompts: LongFact-Objects (lower is better) 0.8
- Hallucination rate on open-source prompts: FActScore (lower is better) 1