Artificial Analysis Intelligence Index v5
Gemini 4 Carbon 59.0 In use Version 5 of Artificial Analysis's index: nine evaluations in four equal categories, most with private test sets, run three times each in its own agent harness.
Released 27 October 2026. Knowledge Work: AA-Briefcase v1.1 15%, AutomationBench-AA 5%, GDP.pdf 5%. Coding: FrontierCode 2.0 15%, Terminal-Bench 4.0 10%. Science: Terminal-Bench-Science 15%, CritPt v2 hard subset 10%. General: AA-Omniscience v1.1 15% (accuracy 10%, non-hallucination 5%), HLE-Diamond 10%. Dropped GDPval-AA, SciCode, AA-LCR and Humanity's Last Exam. Earlier versions have their own records. Scores do not compare across versions. The almanac imports no Artificial Analysis data: its scores here are what labs quote.
- Scored
- Checked automatically A program checks the result against an answer key, unit tests or the expected final state.
- Answers
- Agent task Many steps in a terminal, browser, desktop, app, game or robot.
Gemini 4 Carbon leads with 59.0
Best score per model as labs report them in their own cards. Labs pick their own settings, so these compare less cleanly than independent runs.
| # | Model | Score | Setting | Date | Source |
|---|---|---|---|---|---|
| 1 | Gemini 4 Carbon | 59.0 | Oct 2026 | Model card |
Scores over time
All the scores we have, one dot each, so a model tested at several settings appears more than once.
One lab put it in a launch post in the last six months
Launch posts from every lab that has listed it, one tick per post. Tall colored ticks include it, and short gray ones leave it out.
| Date | Launch post | Score | As the post writes it |
|---|---|---|---|
| 28 Oct 2026 | Gemini 4 Carbon | 59 | AA Index v5.0 |
Versions
More in Other
- Personal Superintelligence Index (Meta) In use Meta's composite of seven personal and knowledge-work evals: Agents' Last Exam, AutomationBench-AA, FocusBench, JobBench, GDP.pdf, VBT and DRACO.
- Anthropic ECI (AECI) Only in system cards Index that combines a basket of capability benchmarks into one capability score to track trends across Anthropic models. Claude Opus 5.5 169.4
- Qwen in-house English automatic evaluation Only in system cards Models answer Qwen in-house English datasets on knowledge, comprehension, coding, math and related skills. Skills and weights change between reports.
Qwen2-72B 72.9% - Recognition of model-written user turns (Anthropic) Only in system cards Models write synthetic user turns for real Claude Code transcripts, then judge which version is real. Score is accuracy above chance. Claude Mythos Preview 0.35
- LiveBench Dropped Models answer monthly refreshed questions across math, coding, reasoning, language, instruction following, and data analysis. Scored automatically against objective ground truth. Claude Fable 5.1 85.7%
- PhiBench Dropped Models answer original prompts that Microsoft's Phi team wrote to test a wide range of skills and reasoning.
Phi-4-Reasoning-plus 74.2%