Putnam 2024
Models write full proofs for the 12 problems of the December 2024 William Lowell Putnam competition. Proofs are graded out of 120 points.
This is a one-time competition exam, not a maintained benchmark. DeepSeekMath-V2 reports 118 of 120 points, given as 98.3%.
- Level
- Competition The strongest students, in olympiad-style contests
- Scored
- Graded by people Human experts grade or compare the outputs.
- Answers
- Written proof
DeepSeekMath-V2 leads with 98.3%
Best score per model as labs report them in their own cards. Labs pick their own settings, so these compare less cleanly than independent runs.
- 1
DeepSeekMath-V2 98.3%
| # | Model | Score | Setting | Date | Source |
|---|---|---|---|---|---|
| 1 | | 98.3% | Nov 2025 | Model card |
The best score passed 85% in Nov 2025
All the scores we have, one dot each, so a model tested at several settings appears more than once.
Labs dropped it from launch posts once the best score passed 85%
Launch posts from every lab that has listed it, one tick per post. Tall colored ticks include it, and short gray ones leave it out.
| Date | Launch post | Score | As the post writes it |
|---|---|---|---|
| 27 Nov 2025 | 98.3 | Putnam 2024 Points (118/120) |
One system card reports it
Besides launch posts, we read the system cards, model cards and technical reports labs publish with a release. They report far more, including safety and frontier-risk tests.
| Date | Document | Score | As the document writes it | Section |
|---|---|---|---|---|
| 27 Nov 2025 | | 98.3 | Putnam 2024 Points, 118 of 120, high-compute search (Table 1) | Capabilities |
Versions
More in Math
- IMO-AnswerBench In use 400 olympiad problems with short verifiable answers, robustified against memorization. Scored by answer match. GLM-5.2 91%
- AIME 2026 In use Models solve the 30 integer-answer problems from the 2026 AIME I and II math competitions. Scored by exact answer match. GPT-5.5 100%
- HMMT 2026 In use Models solve the 33 final-answer problems from the February 2026 Harvard-MIT Mathematics Tournament. Scored by exact answer match. GPT-5.5 98.5%
- MathArena (Apex, IMO, USAMO) In use Evaluates models on newly released math competitions after release. Final-answer or human/LLM-judged proof scores. Claude Opus 4.8 81.3%
- PolyMath In use Models solve 9,000 parallel math problems in 18 languages across four difficulty levels, from school math to frontier math. Final answers are checked.
Qwen3.7-Max 86.5%
- USAMO 2026 In use Models write full proofs for the six problems of the 2026 USA Mathematical Olympiad. Judges grade each proof from 0 to 7 against rubrics. GPT-5.5 98.2%