Benchmark Almanac

First Proof

Not in model cards

AI systems attempt ten unpublished research problems that arose in the authors' own work. Mathematicians judge whether each proof is correct.

An informal round run by the labs themselves. Problems came out on February 5, 2026 and solutions on February 13. Google DeepMind reported its Aletheia agent solved six problems.

In the authors’ words

To assess the ability of current AI systems to correctly answer research-level mathematics questions, we share a set of ten math questions which have arisen naturally in the research process of the authors. The questions had not been shared publicly until now; the answers are known to the authors of the questions but will remain encrypted for a short time.

Abstract of First Proof (arXiv:2602.05192, CC0)
Made by First Proof (Abouzaid, Blumberg, Hairer, Spielman, Williams and others) Released Feb 2026 Research mathematics All tasks public
Level
Research frontier Researchers, on open problems or tasks that take days
Scored
Graded by people Human experts grade or compare the outputs.
Answers
Written proof

No scores here yet

No lab, leaderboard or Epoch AI run has reported a score for First Proof yet.

No lab model card reports it yet

We read the headline results of 479 launch posts from 51 labs, and none of them list this benchmark.

Versions

More in Math

All 105 in Math
  • IMO-AnswerBench In use 400 olympiad problems with short verifiable answers, robustified against memorization. Scored by answer match. GLM-5.2 91%
  • AIME 2026 In use Models solve the 30 integer-answer problems from the 2026 AIME I and II math competitions. Scored by exact answer match. GPT-5.5 100%
  • HMMT 2026 In use Models solve the 33 final-answer problems from the February 2026 Harvard-MIT Mathematics Tournament. Scored by exact answer match. GPT-5.5 98.5%
  • MathArena (Apex, IMO, USAMO) In use Evaluates models on newly released math competitions after release. Final-answer or human/LLM-judged proof scores. Claude Opus 4.8 81.3%
  • PolyMath In use Models solve 9,000 parallel math problems in 18 languages across four difficulty levels, from school math to frontier math. Final answers are checked. Qwen3.7-Max 86.5%
  • USAMO 2026 In use Models write full proofs for the six problems of the 2026 USA Mathematical Olympiad. Judges grade each proof from 0 to 7 against rubrics. GPT-5.5 98.2%