CivBench
Models play full games of Civilization V with the Vox Populi mod against each other on matched maps and seeds. Pairwise skill ratings rank long-term strategy.
Also tracks diplomacy, strategy choices and win prediction quality. The Vox Deorum repo has about 110 stars. Release month is the first Reddit post found.
- Level
- Expert Specialists with years of training, often over hours of work
- Scored
- Ranked by matches Models play against each other, and the results become ratings.
- Answers
- Agent task Many steps in a terminal, browser, desktop, app, game or robot.
GLM-5.3 leads with 1,634
Best score per entry from the benchmark's own leaderboard, read on 2 Nov 2026. Where a model ran with several settings or harnesses, we keep its best. Names in gray aren't in our model list: fine-tunes, agent systems, products and older models. They don't count toward leaders.
- 1,634 GLM-5.3
- 1,602 GPT-6.1 Sol
- 1,593 Claude Opus 5.5
- 1,573 Kimi-K2.7
- 1,557 GPT-6 Astra
- 1,537
DeepSeek V4.1 Flash
- 1,535 GLM-5.2
- 1,516
Qwen 3.8 27B
- 1,510 GPT-6 Luna
- 1,504 Kimi K2.6
- 1,499 Qwen-3.8-Flash-Next
- 1,497 Claude Sonnet 5.5
- 1,482 GLM-5.1
- 1,477
DeepSeek-V4-Flash
- 1,470
MiniMax-M2.7
- 1,468 GLM-5.3-Flash
- 1,460 Qwen-3.5
- 1,458 Gemma-4
- 1,448
MiniMax-M3
- 1,441
Nemotron 3 Super
- 1,422 gpt-oss-120b
- 1,391
Qwen3.6 27B
- 1,350 Jev!
Bars start at 1,300.
- 1 GLM-5.3 1,634
- 2 GPT-6.1 Sol 1,602
- 3 Claude Opus 5.5 1,593
- 4 Kimi-K2.7 1,573
- 5 GPT-6 Astra 1,557
- 6
DeepSeek V4.1 Flash 1,537
- 7 GLM-5.2 1,535
- 8
Qwen 3.8 27B 1,516
- 9 GPT-6 Luna 1,510
- 10 Kimi K2.6 1,504
- 11 Qwen-3.8-Flash-Next 1,499
- 12 Claude Sonnet 5.5 1,497
- 13 GLM-5.1 1,482
- 14
DeepSeek-V4-Flash 1,477
- 15
MiniMax-M2.7 1,470
- 16 GLM-5.3-Flash 1,468
- 17 Qwen-3.5 1,460
- 18 Gemma-4 1,458
- 19
MiniMax-M3 1,448
- 20
Nemotron 3 Super 1,441
- 21 gpt-oss-120b 1,422
- 22
Qwen3.6 27B 1,391
- 23 Jev! 1,350
| # | Entry | Score | Setting | Date | Source |
|---|---|---|---|---|---|
| 1 | GLM-5.3 | 1,634 | every 5 turns | Aug 2026 | Official leaderboard |
| 2 | GPT-6.1 Sol | 1,602 | every 5 turns | Sep 2026 | Official leaderboard |
| 3 | Claude Opus 5.5 | 1,593 | every 5 turns | Sep 2026 | Official leaderboard |
| 4 | Kimi-K2.7 | 1,573 | every turn | Official leaderboard | |
| 5 | GPT-6 Astra | 1,557 | every 5 turns | Sep 2026 | Official leaderboard |
| 6 | | 1,537 | every turn | Sep 2026 | Official leaderboard |
| 7 | GLM-5.2 | 1,535 | every turn | Jun 2026 | Official leaderboard |
| 8 | | 1,516 | every turn | Aug 2026 | Official leaderboard |
| 9 | GPT-6 Luna | 1,510 | every 5 turns | Sep 2026 | Official leaderboard |
| 10 | Kimi K2.6 | 1,504 | every turn | Apr 2026 | Official leaderboard |
| 11 | Qwen-3.8-Flash-Next | 1,499 | every 5 turns | Official leaderboard | |
| 12 | Claude Sonnet 5.5 | 1,497 | every 5 turns | Sep 2026 | Official leaderboard |
| 13 | GLM-5.1 | 1,482 | every turn | Apr 2026 | Official leaderboard |
| 14 | | 1,477 | every 5 turns | Apr 2026 | Official leaderboard |
| 15 | | 1,470 | every turn | Mar 2026 | Official leaderboard |
| 16 | GLM-5.3-Flash | 1,468 | every turn | Aug 2026 | Official leaderboard |
| 17 | Qwen-3.5 | 1,460 | every turn | Official leaderboard | |
| 18 | Gemma-4 | 1,458 | every 5 turns | Official leaderboard | |
| 19 | | 1,448 | every 5 turns | Jun 2026 | Official leaderboard |
| 20 | | 1,441 | every turn | Mar 2026 | Official leaderboard |
| 21 | gpt-oss-120b | 1,422 | every turn | Aug 2025 | Official leaderboard |
| 22 | | 1,391 | every turn | Apr 2026 | Official leaderboard |
| 23 | Jev! | 1,350 | every turn | Official leaderboard |
Number one over time
Lab claims count from the day the card came out, independent runs from the model’s release.
Scores over time
All the scores we have, one dot each, so a model tested at several settings appears more than once.
No lab model card reports it yet
We read the headline results of 479 launch posts from 51 labs, and none of them list this benchmark.
More in Games and long tasks
- ARC-AGI-3 In use Interactive game environments where agents must explore, infer goals and rules, and act efficiently without instructions. GPT-6 Astra 100%
- MineDojo Fading Agents complete open-ended tasks in Minecraft, such as mining blocks and fighting mobs, from a large simulation suite. Programmatic checks score many tasks.
Seed2.0 Pro 49%
- Orak Fading LLM agents play 12 popular video games across most genres through an MCP interface. Scores come from in-game progress or outcomes per title.
Nemotron 3 Nano 4B 22.9
- GameWorld Only in system cards Multimodal game agents play 34 browser games across 170 tasks. Outcomes are checked from the game state.
Gemini 3 Flash 41.9%
- Swarm Bench Only in system cards Models orchestrate agent swarms on complex tasks that benefit from coordinated decomposition and parallel execution. Kimi K3 76.3%
- TextQuests Only in system cards Agents play 25 classic interactive fiction games. Measures game progress and harmful actions per 100 steps.
Muse Spark 2.40