ScanBench
Baichuan-M3-235B 73.8% Fading Models act as doctors in 303 simulated clinical cases from 12 departments. They take a history, order lab tests and give a final diagnosis, scored per stage.
The paper calls it OSCE-like and says the data will be open-sourced. Scores are given for Clinical Inquiry, Laboratory Testing and Diagnosis, with a human doctor baseline. Grader type not checked.
- Level
- Expert Specialists with years of training, often over hours of work
- Scored
- Graded by a model A language model scores each response, usually against a rubric.
- Answers
- Agent task Many steps in a terminal, browser, desktop, app, game or robot.
Baichuan-M3-235B leads with 73.8%
Best score per model as labs report them in their own cards. Labs pick their own settings, so these compare less cleanly than independent runs.
| # | Model | Score | Setting | Date | Source |
|---|---|---|---|---|---|
| 1 | Baichuan-M3-235B | 73.8% | Jan 2026 | Model card |
Scores over time
All the scores we have, one dot each, so a model tested at several settings appears more than once.
Labs headline it less often now, last in Jan 2026
Launch posts from every lab that has listed it, one tick per post. Tall colored ticks include it, and short gray ones leave it out.
| Date | Launch post | Score | As the post writes it |
|---|---|---|---|
| 13 Jan 2026 | Baichuan-M3-235B | 73.8 | Mean of SCAN-bench Clinical Inquiry 74.9 / Lab Test 72.1 / Diagnosis 74.4 |
One system card reports it
Besides launch posts, we read the system cards, model cards and technical reports labs publish with a release. They report far more, including safety and frontier-risk tests.
| Date | Document | Score | As the document writes it | Section |
|---|---|---|---|---|
| 6 Feb 2026 | Baichuan-M3-235B technical report | ScanBench stations Clinical Inquiry 74.9, Laboratory Testing 72.1, Diagnosis 74.4, no overall (4.1.3 text). SCAN inquiry dimensions: Safety Stratification 75.8, Association and Inquiry 72.6, Clarity Matters 84.5, Normative Protocol 59.9 | Health |
More in Law, finance and medicine
- HealthBench Professional In use 525 physician-authored tasks from real clinician chats (care consult, documentation, research) with physician-adjudicated rubrics. Claude Sonnet 5.5 69.2%
- MedXpertQA-MM In use Models answer expert-level medical exam questions that combine images with clinical records and test results. Scoring is accuracy.
Qwen 3.8 Max 80.4% - HealthBench In use 5,000 realistic health conversations graded against physician-written rubrics. A length-adjusted variant penalizes verbosity. GPT-5 67.2%
- KBL In use Models answer Korean legal knowledge and reasoning tasks and Korean bar exam questions. It has 7 knowledge tasks, 4 reasoning tasks and 2,510 bar exam items.
Solar Pro 4 77.5% - KorMedMCQA In use Models answer 7,469 multiple-choice questions from Korean licensing exams for doctors, nurses, pharmacists and dentists, held from 2012 to 2024. Solar Pro 4 93.2%
- PRBench In use Model answers 1,100 expert-written law and finance questions. LLM judge grades against weighted expert rubrics of 10-30 criteria each.
Muse Spark 1.3 61.6%