Introducing Claude 4 (launch post) 22 May 2025
- Agentic coding SWE-bench Verified (parallel test-time compute) 79.4
- Agentic terminal coding Terminal-bench (parallel test-time compute) 50
- Graduate-level reasoning GPQA Diamond (parallel test-time compute) 83.3
- Mean of Agentic tool use TAU-bench Retail / Agentic tool use TAU-bench Airline 70.5
- Multilingual Q&A MMMLU 88.8
- Visual reasoning MMMU (validation) 76.5
- High school math competition AIME 2025 (parallel test-time compute) 90