Science and reasoning
We track 88 benchmarks in science and reasoning, or 92 if you count each version. They run from everyday level to research frontier level.
OpenAI held the top science and reasoning score 40% of the contested time
That's about 18 of the 46 months since January 2023, averaged over the benchmarks below. The easiest benchmarks are at the top. Versions of one test share a row, with a dark tick at each new version. We stop the clock, and fade the rest of the row, when the best score passes 85%, or at the newest score if 45 days go by without another.
Scores come from each benchmark’s own leaderboard, from Epoch AI’s runs and from labs’ reports on their own models. We date Epoch runs by the model’s release and lab reports by when they came out. Labs pick their own settings, so a lab’s claim can beat an independent run of the same model. Turn off lab claims to see independent runs only.
Only each benchmark’s own leaderboard and Epoch AI’s runs, dated by the model’s release. We leave out benchmarks that only labs report.
From everyday to research frontier level
Grouped by who could solve the tasks, from things most adults can do to open research problems. The bar under each name is its best score.
Everyday
Most adults, without training
University
Undergraduates and entry-level professionals
Competition
The strongest students, in olympiad-style contests
Expert
Specialists with years of training, often over hours of work
- GPQA Diamond
- DTBench
- Terminal-Bench-Science
- MysteryMechanism
- xbench-ScienceQA
- LatchBio Capabilities v1.0
- Surface Evolver Bench
- Verifying the Verifiers (Project APE CRED benchmark)
- FrontierPhysics
- CORE-Bench
- BioMysteryBench
- FrontierScience
- LABBench2
- GPQA Main
- scBench (LatchBio SingleCellBench)
- SciUniverse
- SpatialBench (LatchBio)
- BixBench
- Organic Chemistry (Anthropic)
- FrontierScience-Research
- Matbench
- SciReasoner evaluation suite
- Biomedical image analysis (Anthropic)
- BioPipelineBench (Anthropic)
- GPQA Extended
- Medicinal Chemistry (Anthropic)
- Morphology-to-molecule matching (Anthropic)
- Phylogenetics (Anthropic)
- ChemBench
- De novo protein binder design (Anthropic)
- PHYSICS
- SGI-Bench
- Structural Biology (Anthropic)
- SuperMatBench
- BioPipelineBench Verified (Anthropic)
- Organic Chemistry V2 (Anthropic)
- Protein Design (Anthropic)
- Anthropic internal life-sciences evals
- FrontierChallenge
- MaCBench
- ScholarCatalyst
- SciArena
- ScienceAgentBench
- SciPredict
- SciTS
Research frontier
Researchers, on open problems or tasks that take days
By kind
Science questions
| Benchmark | Level | Scored | Best score | Status |
|---|---|---|---|---|
| GPQA Diamond 198 graduate-level 'Google-proof' multiple-choice questions in biology, chemistry and physics. | Expert | Checked automatically | | In use |
| xbench-ScienceQA Models answer postgraduate-level science questions written by experts, in Chinese, as part of the xbench AGI Tracking series. | Expert | Checked automatically | 76.4% | Not in cards |
| GPQA Main Models answer the 448 question main set of GPQA, graduate level biology, chemistry and physics questions written by experts. Scored by accuracy. | Expert | Checked automatically | 49.1% | Dropped |
| ATLAS (OpenCompass) Models answer about 800 original PhD-level problems across mathematics, physics, chemistry, biology, computer science, earth science and materials science. Answers are open-form and checked by an LLM judge. | Research frontier | Graded by a model | 42.9% | Not in cards |
| PhyX Models solve 3,000 image-based physics problems across six domains such as mechanics and optics. Versions include multiple choice and open-ended answers. | University | Graded by a model | | Fading |
| PhysicsFinals Models answer 61 undergraduate physics final exam problems written by physics professors. A professor grades the answers. | University | Graded by people | | Dropped |
| TheoremQA Models solve 800 university-level questions in math, physics, EE and CS, and finance that each need a specific theorem. Scored by answer accuracy. | University | Checked automatically | | Dropped |
| GPQA Extended Models answer all 546 GPQA questions, graduate level biology, chemistry and physics questions written by experts. Scored by accuracy. | Expert | Checked automatically | 48.8% | System cards only |
| GRE Physics Models answer questions from official GRE Physics practice tests. Scored as accuracy. | University | Checked automatically | | System cards only |
| ChemBench Models answer more than 2,700 chemistry questions on knowledge and reasoning. Results are compared with a group of human chemists. | Expert | Checked automatically | | Dropped |
| PHYSICS Models solve 1,297 PhD qualifying exam physics problems across six subfields, 298 of them with images. Answers are checked by symbolic equivalence. | Expert | Checked automatically | | Dropped |
| A^3-Bench Models solve 2,198 science reasoning problems annotated with the anchors and attractors (prior knowledge) they need. An AAUI metric measures how much of that knowledge the model activates. | University | Checked automatically | Not in cards | |
| SciArena Researchers ask scientific literature questions and vote between two models' long cited answers. Votes give Elo ratings. | Expert | Ranked by votes | Not in cards | |
| SciQ Models answer crowdsourced multiple-choice science exam questions in physics, chemistry and biology, each with a supporting passage. | School | Checked automatically | Not in cards |
Science olympiads
| Benchmark | Level | Scored | Best score | Status |
|---|---|---|---|---|
| HiPhO Models solve theory problems from 2024 and 2025 physics olympiad exams, some with diagrams. Official marking schemes grade answers and steps, mapped to medal levels. | Competition | Graded by a model | | In use |
| PHYBench Models solve 500 original physics problems from high school to Physics Olympiad level. Answers are expressions checked against the key. | Competition | Checked automatically | | Fading |
| OlympicArena Models solve 11,163 bilingual problems from 62 international olympiad competitions in seven fields, some with images. Answers are checked against keys. | Competition | Checked automatically | 40.5% | Dropped |
| FrontierScience-Olympiad Models solve olympiad-style physics, chemistry and biology problems at the level of IPhO, IChO and IBO, written by medalists and coaches. Graded on short final answers. | Competition | Checked automatically | | System cards only |
| IPhO 2025 Models solve the theory problems of the 2025 International Physics Olympiad. Answers are graded against the official marking scheme. | Competition | Graded by people | | Fading |
| IChO 2025 Models solve the written theoretical problems of the 57th International Chemistry Olympiad, held in Dubai in July 2025. Answers are graded against the official marking scheme. | Competition | Graded by people | Fading | |
| USABO Semifinal Exam 2020 Models take the 2020 USA Biology Olympiad semifinal exam. Scored out of 150 points. | Competition | Checked automatically | 87.0 | System cards only |
| USNCO Local Section Exam 2022 Models take the 2022 US National Chemistry Olympiad local section exam. Scored out of 60 questions. | Competition | Checked automatically | 36.0 | System cards only |
Research science
| Benchmark | Level | Scored | Best score | Status |
|---|---|---|---|---|
| CritPt 71 frontier physics research challenges with checkable answers. Anthropic uses a corrected internal version. | Research frontier | Checked automatically | | In use |
| Terminal-Bench-Science 70 scientific research-workflow tasks across five science areas, run in Harbor containers. Hidden tests give the resolution rate. | Expert | Checked automatically | 68.1% | In use |
| Surface Evolver Bench Agents write Surface Evolver datafiles that model liquid surfaces under physical constraints across 16 tasks. Deterministic checks give partial credit for matching hidden reference quantities. | Expert | Checked automatically | 95% | Not in cards |
| ResearchClawBench Agents get the literature and raw data behind a published paper, with the paper hidden, and try to rediscover its results. Expert rubrics with weighted criteria grade the outputs. | Research frontier | Graded by a model | | Not in cards |
| Verifying the Verifiers (Project APE CRED benchmark) Verifier LLMs must find planted errors (prose-table, paper-code, execution, data) in AI-generated economics papers. Credit needs a verbatim quote of the edit. | Expert | Checked automatically | 99.5% | Not in cards |
| BixBench3 Agents rebuild the full computational analysis of 20 published biology papers from raw data on a cloud VM. Output tables are graded against the papers' own artifacts. | Research frontier | Checked automatically | | Not in cards |
| FrontierPhysics 56 specialist physics-research tasks in 9 domains. Graded by verifier pass plus a weighted rubric score over 3 trials. | Expert | Checked automatically | 22.6% | Not in cards |
| NatureBench Coding agents work on 90 tasks distilled from Nature-family papers, each in its own container, and try to match or beat the published results. | Research frontier | Checked automatically | 26.7% | Not in cards |
| CORE-Bench Agents reproduce the results of published studies from their code and data. 270 tasks from 90 papers in computer science, social science and medicine come in three difficulty levels. | Expert | Checked automatically | 77.8% | Not in cards |
| FrontierScience Models solve physics, chemistry, and biology problems in an Olympiad track graded by short answer and a Research track graded by 10-point rubrics. | Expert | Graded by a model | | In use |
| CritPt v2 Models solve unpublished research-level physics challenges written by working physicists, with answers graded automatically. The v2 release revised the public test challenges. | Research frontier | Checked automatically | 83.1% | Not in cards |
| ExplorationBench Agents explore verifiable alien worlds with hidden laws, framing hypotheses and running experiments. The worlds are built so that recalled pretraining knowledge does not help. | Research frontier | Checked automatically | 89% | Not in cards |
| PaperBenchX Agents reproduce published results from 12 research areas outside machine learning, using each field's own scientific software. Verifiers check that the evidence regenerates and supports the paper's claims. | Research frontier | Checked automatically | 14% | Not in cards |
| Organic Chemistry (Anthropic) Models predict structures from spectra, design synthetic routes, predict reaction products and convert between IUPAC names, SMILES and structure images. | Expert | Checked automatically | 86.2% | System cards only |
| CMT-Benchmark Models solve 50 research-level condensed matter theory problems written and checked by a panel of expert physicists. Answers are graded automatically. | Research frontier | Checked automatically | | Fading |
| FrontierScience-Research Models work on open-ended PhD-level research subtasks in physics, chemistry and biology, written by working scientists. A grader scores each answer against a 10-point rubric. | Expert | Graded by a model | 36.7% | Fading |
| Matbench Models predict properties of inorganic materials in 13 supervised tasks built from DFT and experimental data. Scored with error or classification metrics per task. | Expert | Checked automatically | | Fading |
| SciReasoner evaluation suite Models perform scientific sequence and text tasks such as format translation, extraction, property prediction and molecule design, drawn from up to 103 tasks. | Expert | Checked automatically | | Fading |
| Biomedical image analysis (Anthropic) Models run quantitative analyses of CT, MRI, histopathology and other images from public competitions. Scores are scaled to the best competition results. | Expert | Checked automatically | 72.2% | System cards only |
| Medicinal Chemistry (Anthropic) Models see several real drug-discovery compounds and pick which had the highest or lowest measured ADME property. The set has 504 questions. | Expert | Checked automatically | 65.3% | System cards only |
| Morphology-to-molecule matching (Anthropic) Models match four sets of multi-channel liver cell images to the four shuffled molecule and dose treatments that produced them. | Expert | Checked automatically | 34% | System cards only |
| Phylogenetics (Anthropic) Models analyze phylogenetic data and tree diagrams, testing quantitative reasoning about tree structure and visual interpretation. | Expert | Checked automatically | 79.6% | System cards only |
| ProteinGym Deep mutational scanning benchmarks. The model ranks mutations by predicted effect on protein function. Anthropic reports a hard subset. | Research frontier | Checked automatically | 47.7% | System cards only |
| De novo protein binder design (Anthropic) Agents get a target protein structure and 24 hours to design 30 miniprotein binders. The evaluation covers 15 targets. | Expert | Checked automatically | 82.6% | System cards only |
| SGI-Bench Models work through more than 1,000 expert samples in four scientist tasks: deep research, idea generation, dry and wet experiments, and experimental reasoning. | Expert | Graded by a model | | In use |
| Structural Biology (Anthropic) Models answer questions about a biomolecule's function from structural data and basic tools, in multiple-choice and open-ended variants. | Expert | Checked automatically | 79% | System cards only |
| SuperMatBench Models answer materials chemistry questions in a QA part and solve materials tasks with tools in an Agent part. | Expert | Checked automatically | | In use |
| Organic Chemistry V2 (Anthropic) Models predict structures from spectra, design multi-step syntheses, predict reaction products and read chemical structure images. V2 adds harder expert-recommended problems. | Expert | Checked automatically | 61.6% | System cards only |
| Protein Design (Anthropic) Models generate novel protein sequences under design constraints and rank protein design libraries for experimental testing. | Expert | Checked automatically | 42.5% | System cards only |
| Anthropic internal life-sciences evals Internal suite: morphology-to-molecule matching, medicinal chemistry, protein design, binder design, biomedical image analysis, organic chemistry. | Expert | Checked automatically | Not in cards | |
| Apodex Discovery Solver systems of model, harness and tools run long, verifiable investigations on high-value problems scouted from 561 industries in 16 sectors. | Research frontier | Checked automatically | Not in cards | |
| ArXivPhys Models answer research-level physics questions derived from recent arXiv papers, each with a reference final answer. | Research frontier | Checked automatically | Not in cards | |
| ASI-Bench AI systems try to explore unknown problems, create new knowledge and turn new ideas into verifiable results, rather than apply learned knowledge. | Research frontier | Checked automatically | Not in cards | |
| EurekaBench Agents run long experiments and propose mechanisms that explain observations in six sciences. Mechanisms are scored on known constraints, predictive accuracy and the 306 expert-listed insights they should support. | Research frontier | Graded by a model | Not in cards | |
| FrontierChallenge Agents complete end-to-end scientific workflows in chemistry, materials, molecular dynamics and life science from fixed inputs, producing a set of required deliverables. Task-specific graders check each deliverable. | Expert | Checked automatically | Not in cards | |
| Into the Unknown Agents get a science paper and an unpublished follow-up direction from a DOE national lab scientist, then write the follow-up paper. Rubrics built from the scientist's conditions grade it, plus an integrity check. | Research frontier | Graded by a model | Not in cards | |
| PhysClosureBench Agents run 50 expert-verified physics research tasks in strong-field and attosecond physics, deciding how to generate and validate evidence. A 20-criterion score and a closure level from RC0 to RC4 grade them. | Research frontier | Graded by a model | Not in cards | |
| ScholarCatalyst Given a research question, retrieve the 'catalyst papers' that 184 lead authors labeled for 207 projects, searching only prior literature. Recall@20. | Expert | Checked automatically | Not in cards | |
| ScienceAgentBench Agents write programs for 102 data-driven discovery tasks from 44 papers in four disciplines. Outputs are checked by execution and task-specific metrics. | Expert | Checked automatically | Not in cards | |
| SciPredict Models predict the outcomes of 405 real physics, biology and chemistry experiments published after March 31, 2025, with and without expert background knowledge. | Expert | Checked automatically | Not in cards | |
| SciTS Models understand and generate scientific time series in 43 tasks across 12 domains. Signals range from one to ten million points. Each task uses its own metric. | Expert | Checked automatically | System cards only | |
| TheoPhysEval Agents solve 50 unpublished research-level theoretical physics problems on their own, with literature search and scripts. Each final answer is checked against an expert answer, and the score is the pass rate. | Research frontier | Checked automatically | Not in cards |
Lab and data work
| Benchmark | Level | Scored | Best score | Status |
|---|---|---|---|---|
| LatchBio Capabilities v1.0 LatchBio cross-benchmark suite of agentic biological data analysis (transcriptomics, epigenomics, variants, pharmacology) with deterministic graders. | Expert | Checked automatically | 58% | System cards only |
| BioMysteryBench Bioinformatics problems on anonymized real datasets that require real analysis with tools. Rubric-graded, with human-solvable and human-difficult splits. | Expert | Checked automatically | 90.1% | In use |
| LABBench2 11 biology research sub-tasks (literature, figures, tables, patents, trials and more) with tool access. Macro-averaged accuracy. | Expert | Checked automatically | 60.9% | In use |
| scBench (LatchBio SingleCellBench) 195 verifiable single-cell RNA-seq analysis problems. Each pairs a data snapshot with a task and a deterministic grader. | Expert | Checked automatically | 61.2% | System cards only |
| SciUniverse 92 tasks in 17 chemistry, biology and materials families run in C5R's lab or its digital twin. Pass@1 averaged equally across families. | Expert | Checked automatically | 45.3% | Not in cards |
| SpatialBench (LatchBio) Agentic spatial-transcriptomics data analysis problems with deterministic graders. Anthropic reports a 115-problem Verified variant. | Expert | Checked automatically | 72.5% | System cards only |
| BixBench Computational-biology analysis tasks (differential expression, assembly QC, cell typing) answered by agents with tools. | Expert | Checked automatically | 93.8% | Fading |
| BioPipelineBench (Anthropic) Agents execute bioinformatics workflows such as long-read sequence analysis, metagenome assembly and chromatin profiling with a bash tool. | Expert | Checked automatically | 87.7% | System cards only |
| BioPipelineBench Verified (Anthropic) Agents execute bioinformatics workflows with a bash tool. Only problems that passed a validation check by external reviewers are kept. | Expert | Checked automatically | 83.6% | System cards only |
| MaCBench Vision language models answer chemistry and materials questions from images. Tasks cover reading data, understanding experiments and interpreting results. | Expert | Checked automatically | Not in cards | |
| ScienceWorld Agents carry out elementary-school science tasks, such as measuring conductivity or growing plants, by acting in an interactive text environment. Each task scores progress toward its goal. | School | Checked automatically | Not in cards |
Abstract puzzles and logic
| Benchmark | Level | Scored | Best score | Status |
|---|---|---|---|---|
| DTBench Models answer 407 multiple-choice questions on decision theory in Newcomb-like problems, where choices predict the behavior of copies. Scored by accuracy. | Expert | Checked automatically | 98.2% | System cards only |
| ARC-AGI-2 Models infer a rule from example grid pairs and produce the output grid for new inputs. Scored by tasks solved within two attempts. | Everyday | Checked automatically | 95% | In use |
| ARC-AGI Few-shot grid puzzles: infer a hidden transformation from about three examples and produce the output grid. Semi-private sets verified by ARC Prize. | Everyday | Checked automatically | 98.5% | In use |
| SimpleBench Models answer over 200 multiple-choice trick questions on spatial, temporal, and social reasoning that ordinary people solve. Scored by average accuracy over five runs. | Everyday | Checked automatically | 88.4% | Not in cards |
| ZebraLogic Models solve logic grid puzzles of controlled size, derived from constraint satisfaction problems. Scored by the share of puzzles solved fully. | School | Checked automatically | | Fading |
| Misguided Attention Models get slight variations of famous riddles, paradoxes and thought experiments. A model fails when it answers the well-known original instead of the problem as stated. | Everyday | Graded by a model | 73.7% | Not in cards |
| KOR-Bench Models read a new rule set and apply it to questions in five task types: operation, logic, cipher, puzzle and counterfactual. Scored by accuracy against an answer key. | University | Checked automatically | 72.9% | Fading |
| MysteryMechanism Agents recover a hidden mathematical law from two noisy observations and a few experiments they choose. The submitted expression is run on private probes and passes if its error is under a noise-aware threshold. | Expert | Checked automatically | 53.1% | Not in cards |
| General365 Models solve 365 hand-written reasoning problems and 1,095 variants in eight categories that need only K-12 knowledge. Scoring mixes rule-based and model-based checks. | Everyday | Checked automatically | | Not in cards |
| AutoLogi Models solve open-ended logic puzzles in English and Chinese. Generated verifier programs check each answer against the puzzle constraints. | School | Checked automatically | 89.5% | Dropped |
| 3SAT-Search Models find satisfying assignments for 800 3-SAT formulas across difficulty levels. A checker verifies each assignment. | University | Checked automatically | | System cards only |
| BA-Calendar Models find a common meeting slot for several people under constraints such as time zones, buffer time and priority. 2,000 problems checked by code. | Everyday | Checked automatically | | System cards only |
| Novel logical reasoning problems expert evaluation (Z.ai) Human experts score model answers to new multi-step logic problems with a fixed scoring standard for each question. | University | Graded by people | 62.0 | System cards only |
| ProcBench Models follow explicit step-by-step procedures to answer questions, which isolates multi-step inference from knowledge and search. | Everyday | Checked automatically | | Fading |
| Sudoku-Bench Models solve Sudoku variants with unusual rule sets that need creative, multi-step deduction. Scored by the share of puzzles solved. | Competition | Checked automatically | | Dropped |
| TSP-Opt Models find optimal tours for 960 traveling salesman instances across 8 difficulty levels. Answers are checked for optimality. | University | Checked automatically | | System cards only |
| DeepPHY Agentic vision-language models act in simulated physics environments of varied difficulty that test understanding of basic physical principles. | Everyday | Checked automatically | Not in cards |