Inkling-Small (Thinking Machines news) 30 Jul 2026
- AA Index v4.1 40
- SWEBench Verified (bash-only harness) 80.2
- SWEBench Pro public 55.9
- Terminal Bench 2.1 (best harness) 64.7
- SciCode 48.7
- GDPval-AA v2 1269
- MCP Atlas public 79.6 / all 79.2 79.6
- Tau 3 Banking 15.5
- BrowseComp with context management 77.4
- Toolathlon Verified 54.4
- AA-Briefcase 917
- GPQA Diamond 89.5
- Best of HLE text only 31.6 / HLE with tools 47.8 47.8
- AIME 2026 95.5
- HMMT Feb 2026 90.2
- CritPt 8.3
- ARC-AGI-1 84
- ARC-AGI-2 40.1
- SimpleQA Verified 20.6
- AA Omniscience index -9
- IFBench 82.2
- Global-MMLU-Lite 86.7
- StrongREJECT 98.4
- FORTRESS adversarial 71.6 (benign 96.9) 71.6
- MMMU Pro Standard 10 74
- Best of Charxiv RQ original 77.4 / with python 81.3 81.3
- Audio MC 54.9
- MMAU 77
- VoiceBench 90.1
- Best of ForecastBench Brier Index no search 61.3 / with search 61.5 61.5
- Prophet Arena Brier Score (lower is better) 0.124