SkillsBench
86-87 containerized expert tasks in 11 domains, run with and without Agent Skills. Verifier tests give pass rate and skill lift.
Paired runs with and without skills isolate the effect of skills. SkillsBench 1.1 (June 2026) pins 87 tasks in 8 domains, up from 86 in the first paper version. The task set is the same as v1.0.
In the authors’ words
Agent Skills are structured packages of procedural knowledge that augment large language model (LLM) agents at inference time. Despite rapid adoption, there is no standard way to measure whether they actually help. We present SkillsBench, a benchmark whose current inventory contains 87 tasks across 8 domains paired with curated Skills and deterministic verifiers. Our latest aggregate evaluation runs the 87-task benchmark under matched no-Skills and curated-Skills conditions for 18 model-harness configurations. Curated Skills raise the average pass rate from 33.9% to 50.5% (+16.6 percentage points; 25.5% normalized gain), with configuration-level gains ranging from +4.1 to +25.7 pp. Focused Skills with at most three modules outperform larger or exhaustive bundles, and smaller models with Skills can match larger models without them. SkillsBench establishes paired evaluation as the foundation for rigorous measurement of Skill efficacy on agentic, expertise-heavy work.
- Level
- Expert Specialists with years of training, often over hours of work
- Scored
- Checked automatically A program checks the result against an answer key, unit tests or the expected final state.
- Answers
- Agent task Many steps in a terminal, browser, desktop, app, game or robot.
GPT-5.5 leads with 67.3% among models released by Jun 2026
Best score per model from the benchmark's own leaderboard, read on 2 Nov 2026. Where a model ran with several settings or harnesses, we keep its best.
The newest model with a score here came out in Jun 2026, and nobody has tested a newer one. Among the 20 highest-ranked models on the capability index, these have no score yet:
- GPT-6 Astra
- Claude Opus 5.5
- GPT-6.1 Terra
- GPT-6.1 Sol
- and 14 more
- 67.3 GPT-5.5
- 61.2 Claude Opus 4.7
- 60.8
Gemini 3.1 Pro
- 58.4 GLM-5.1
- 54.6
Gemini 3 Flash
- 54.1 Claude Opus 4.8
- 54.0 Kimi K2.6
- 53.0
MiniMax-M3
- 51.7 GPT-5.2
- 50.2 Claude Opus 4.6
- 50.1
DeepSeek-V4-Pro
- 49.0 Claude Opus 4.5
- 48.2
Gemini 3.5 Flash
- 47.2 Claude Sonnet 4.6
- 44.7
DeepSeek-V4-Flash
- 41.7 Grok 4.3
- 41.4 GPT-5.4 Mini
- 36.2 Claude Sonnet 4.5
- 34.9
MiniMax-M2.7
- 30.1 Claude Haiku 4.5
- 20.1
Gemini 3.1 Flash-Lite
- 1 GPT-5.5 67.3%
- 2 Claude Opus 4.7 61.2%
- 3
Gemini 3.1 Pro 60.8%
- 4 GLM-5.1 58.4%
- 5
Gemini 3 Flash 54.6%
- 6 Claude Opus 4.8 54.1%
- 7 Kimi K2.6 54%
- 8
MiniMax-M3 53%
- 9 GPT-5.2 51.7%
- 10 Claude Opus 4.6 50.2%
- 11
DeepSeek-V4-Pro 50.1%
- 12 Claude Opus 4.5 49%
- 13
Gemini 3.5 Flash 48.2%
- 14 Claude Sonnet 4.6 47.2%
- 15
DeepSeek-V4-Flash 44.7%
- 16 Grok 4.3 41.7%
- 17 GPT-5.4 Mini 41.4%
- 18 Claude Sonnet 4.5 36.2%
- 19
MiniMax-M2.7 34.9%
- 20 Claude Haiku 4.5 30.1%
- 21
Gemini 3.1 Flash-Lite 20.1%
| # | Model | Score | Setting | Date | Source |
|---|---|---|---|---|---|
| 1 | GPT-5.5 | 67.3% | OpenHands | Apr 2026 | Official leaderboard |
| 2 | Claude Opus 4.7 | 61.2% | Claude Code | Apr 2026 | Official leaderboard |
| 3 | | 60.8% | Gemini CLI | Feb 2026 | Official leaderboard |
| 4 | GLM-5.1 | 58.4% | OpenHands | Apr 2026 | Official leaderboard |
| 5 | | 54.6% | Gemini CLI | Dec 2025 | Official leaderboard |
| 6 | Claude Opus 4.8 | 54.1% | OpenHands | May 2026 | Official leaderboard |
| 7 | Kimi K2.6 | 54% | OpenHands | Apr 2026 | Official leaderboard |
| 8 | | 53% | OpenHands | Jun 2026 | Official leaderboard |
| 9 | GPT-5.2 | 51.7% | Codex | Dec 2025 | Official leaderboard |
| 10 | Claude Opus 4.6 | 50.2% | Claude Code | Feb 2026 | Official leaderboard |
| 11 | | 50.1% | OpenHands | Apr 2026 | Official leaderboard |
| 12 | Claude Opus 4.5 | 49% | Claude Code | Nov 2025 | Official leaderboard |
| 13 | | 48.2% | OpenHands | May 2026 | Official leaderboard |
| 14 | Claude Sonnet 4.6 | 47.2% | OpenHands | Feb 2026 | Official leaderboard |
| 15 | | 44.7% | OpenHands | Apr 2026 | Official leaderboard |
| 16 | Grok 4.3 | 41.7% | OpenHands | Apr 2026 | Official leaderboard |
| 17 | GPT-5.4 Mini | 41.4% | OpenHands | Mar 2026 | Official leaderboard |
| 18 | Claude Sonnet 4.5 | 36.2% | Claude Code | Sep 2025 | Official leaderboard |
| 19 | | 34.9% | OpenHands | Mar 2026 | Official leaderboard |
| 20 | Claude Haiku 4.5 | 30.1% | Claude Code | Oct 2025 | Official leaderboard |
| 21 | | 20.1% | OpenHands | Mar 2026 | Official leaderboard |
Labs report scores for 13 models in their cards. We plot every source in the charts below.
4 models have held number one since its release in Feb 2026
Lab claims count from the day the card came out, independent runs from the model’s release. We draw one row each for the benchmark’s own leaderboard and what labs claim in their cards.
Scores over time
All the scores we have, one dot each, so a model tested at several settings appears more than once.
4 labs put it in a launch post in the last six months
Launch posts from every lab that has listed it, one tick per post. Tall colored ticks include it, and short gray ones leave it out.
| Date | Launch post | Score | As the post writes it |
|---|---|---|---|
| 13 Oct 2026 | 68.7 | SkillsBench | |
| 28 Aug 2026 | 62.9 | SkillsBench (79, text-only) | |
| 10 Aug 2026 | 44.3 | SkillsBench (with skills) | |
| 3 Aug 2026 | 70.2 | SkillsBench | |
| 2 Jul 2026 | 55.3 | SkillsBench (79, text-only) | |
| 1 Jun 2026 | 54.9 | Skillsbench (OpenCode, 78 tasks, avg of 5) | |
| 20 May 2026 | 59.2 | Skillsbench | |
| 28 Apr 2026 | 43.7 | SkillsBench | |
| 22 Apr 2026 | 48.2 | SkillsBench Avg5 (OpenCode, 78 tasks) | |
| 20 Apr 2026 | 55.6 | SkillsBench Agent Skills | |
| 15 Apr 2026 | 28.7 | SkillsBench Avg5 | |
| 2 Apr 2026 | 45.7 | SkillsBench Avg5 |
2 system cards report it, from 2 labs
Besides launch posts, we read the system cards, model cards and technical reports labs publish with a release. They report far more, including safety and frontier-risk tests.
| Date | Document | Score | As the document writes it | Section |
|---|---|---|---|---|
| 19 Oct 2026 | | 44.3 | SkillsBench, high (Tables 2 and 5) | Capabilities |
| 23 Jun 2026 | | 60.4 | SkillsBench, stated in the 2.3.2 text | Capabilities |
More in Terminal agents
- Terminal-Bench 4.0 In use Agents complete 66 hard tasks in containerized terminals across software, ML, science, security, and operations. Test scripts verify each result, scored as resolution rate. Claude Opus 5.5 64.8%
- Terminal-Bench Hard In use Agents complete 44 hard tasks from Terminal-Bench Core in the Terminus 2 harness. Artificial Analysis scores pass@1 averaged over 3 repeats.
Gemma 4 31B IT 36%
- Harbor-Index In use Agents solve about 80 hard tasks drawn from 29 benchmarks run through Harbor adapters, such as HLE, GSO and SWE-bench Pro. Each task keeps its source verifier. GPT-5.5 28.1%
- CompileBench Not in model cards Agents build real open-source projects through dependency problems, legacy toolchains and complex build systems, for example compiling 22-year-old code. Claude Opus 4.1 100%
- Long-Horizon-Terminal-Bench 2.0 Not in model cards Agents work for up to 3 hours per task on 77 container tasks, including 30 tasks that rebuild a scientific tool from its outputs. Hidden verifiers give partial-credit rewards. GPT-6 Astra 69.2%
- ITBench Not in model cards Agents handle IT automation tasks in Kubernetes environments: site reliability incidents, compliance and security checks, and cloud cost work.
Gemini 3 Pro 58.3%