Benchmark Almanac

SkillsBench

GPT-5.5 67.3% leads since Apr 2026 In use

86-87 containerized expert tasks in 11 domains, run with and without Agent Skills. Verifier tests give pass rate and skill lift.

Paired runs with and without skills isolate the effect of skills. SkillsBench 1.1 (June 2026) pins 87 tasks in 8 domains, up from 86 in the first paper version. The task set is the same as v1.0.

In the authors’ words

Agent Skills are structured packages of procedural knowledge that augment large language model (LLM) agents at inference time. Despite rapid adoption, there is no standard way to measure whether they actually help. We present SkillsBench, a benchmark whose current inventory contains 87 tasks across 8 domains paired with curated Skills and deterministic verifiers. Our latest aggregate evaluation runs the 87-task benchmark under matched no-Skills and curated-Skills conditions for 18 model-harness configurations. Curated Skills raise the average pass rate from 33.9% to 50.5% (+16.6 percentage points; 25.5% normalized gain), with configuration-level gains ranging from +4.1 to +25.7 pp. Focused Skills with at most three modules outperform larger or exhaustive bundles, and smaller models with Skills can match larger models without them. SkillsBench establishes paired evaluation as the foundation for rigorous measurement of Skill efficacy on agentic, expertise-heavy work.

Abstract of SkillsBench: Benchmarking How Well Agent Skills Work Across Diverse Tasks (arXiv:2602.12670, CC0)
Made by BenchFlow + 105 domain experts Released Feb 2026 Terminal tasks All tasks public Last in a launch post Oct 2026 Last model added Oct 2026 Scores refreshed 2 Nov 2026
Level
Expert Specialists with years of training, often over hours of work
Scored
Checked automatically A program checks the result against an answer key, unit tests or the expected final state.
Answers
Agent task Many steps in a terminal, browser, desktop, app, game or robot.
21
Models scored on its own leaderboard
12
Launch posts list it, from 5 labs
2
System cards report it, from 2 labs

GPT-5.5 leads with 67.3% among models released by Jun 2026

Best score per model from the benchmark's own leaderboard, read on 2 Nov 2026. Where a model ran with several settings or harnesses, we keep its best.

The newest model with a score here came out in Jun 2026, and nobody has tested a newer one. Among the 20 highest-ranked models on the capability index, these have no score yet:

  1. 1 GPT-5.5 67.3%
  2. 2 Claude Opus 4.7 61.2%
  3. 3 Gemini 3.1 Pro 60.8%
  4. 4 GLM-5.1 58.4%
  5. 5 Gemini 3 Flash 54.6%
  6. 6 Claude Opus 4.8 54.1%
  7. 7 Kimi K2.6 54%
  8. 8 MiniMax-M3 53%
  9. 9 GPT-5.2 51.7%
  10. 10 Claude Opus 4.6 50.2%
  11. 11 DeepSeek-V4-Pro 50.1%
  12. 12 Claude Opus 4.5 49%
  13. 13 Gemini 3.5 Flash 48.2%
  14. 14 Claude Sonnet 4.6 47.2%
  15. 15 DeepSeek-V4-Flash 44.7%
  16. 16 Grok 4.3 41.7%
  17. 17 GPT-5.4 Mini 41.4%
  18. 18 Claude Sonnet 4.5 36.2%
  19. 19 MiniMax-M2.7 34.9%
  20. 20 Claude Haiku 4.5 30.1%
  21. 21 Gemini 3.1 Flash-Lite 20.1%
#ModelScoreSettingDateSource
1 GPT-5.5 67.3% OpenHands Apr 2026 Official leaderboard
2 Claude Opus 4.7 61.2% Claude Code Apr 2026 Official leaderboard
3 Gemini 3.1 Pro 60.8% Gemini CLI Feb 2026 Official leaderboard
4 GLM-5.1 58.4% OpenHands Apr 2026 Official leaderboard
5 Gemini 3 Flash 54.6% Gemini CLI Dec 2025 Official leaderboard
6 Claude Opus 4.8 54.1% OpenHands May 2026 Official leaderboard
7 Kimi K2.6 54% OpenHands Apr 2026 Official leaderboard
8 MiniMax-M3 53% OpenHands Jun 2026 Official leaderboard
9 GPT-5.2 51.7% Codex Dec 2025 Official leaderboard
10 Claude Opus 4.6 50.2% Claude Code Feb 2026 Official leaderboard
11 DeepSeek-V4-Pro 50.1% OpenHands Apr 2026 Official leaderboard
12 Claude Opus 4.5 49% Claude Code Nov 2025 Official leaderboard
13 Gemini 3.5 Flash 48.2% OpenHands May 2026 Official leaderboard
14 Claude Sonnet 4.6 47.2% OpenHands Feb 2026 Official leaderboard
15 DeepSeek-V4-Flash 44.7% OpenHands Apr 2026 Official leaderboard
16 Grok 4.3 41.7% OpenHands Apr 2026 Official leaderboard
17 GPT-5.4 Mini 41.4% OpenHands Mar 2026 Official leaderboard
18 Claude Sonnet 4.5 36.2% Claude Code Sep 2025 Official leaderboard
19 MiniMax-M2.7 34.9% OpenHands Mar 2026 Official leaderboard
20 Claude Haiku 4.5 30.1% Claude Code Oct 2025 Official leaderboard
21 Gemini 3.1 Flash-Lite 20.1% OpenHands Mar 2026 Official leaderboard

Labs report scores for 13 models in their cards. We plot every source in the charts below.

4 models have held number one since its release in Feb 2026

Lab claims count from the day the card came out, independent runs from the model’s release. We draw one row each for the benchmark’s own leaderboard and what labs claim in their cards.

Google DeepMind Anthropic OpenAI Qwen ByteDance Seed
Own leaderboard Not tested since Jun 2026
GPT-5.5 67.3%
Lab claims 5 leaders
Qwen 3.8 Max 70.2%

Scores over time

All the scores we have, one dot each, so a model tested at several settings appears more than once.

On the benchmark’s own leaderboard Reported by the lab in its model card Best so far
0% 20% 40% 60% 80% 100% 2026 Near the ceiling (85%) Qwen 3.8 Max GPT-5.5 Claude Opus 4.7 Gemini 3 Flash Claude Opus 4.5 Claude Sonnet 4.5 0% 20% 40% 60% 80% 100% 2026 Near the ceiling (85%) Qwen 3.8 Max Claude Opus 4.7

4 labs put it in a launch post in the last six months

Launch posts from every lab that has listed it, one tick per post. Tall colored ticks include it, and short gray ones leave it out.

Qwen
ByteDance Seed
Tencent
Meta
Ant Group
DateLaunch postScoreAs the post writes it
13 Oct 2026 Ling-3.1-flash 68.7 SkillsBench
28 Aug 2026 Tencent Hy4 preview 62.9 SkillsBench (79, text-only)
10 Aug 2026 Muse Glimmer 44.3 SkillsBench (with skills)
3 Aug 2026 Qwen 3.8 Max 70.2 SkillsBench
2 Jul 2026 Tencent Hy3 55.3 SkillsBench (79, text-only)
1 Jun 2026 Qwen3.7-Plus 54.9 Skillsbench (OpenCode, 78 tasks, avg of 5)
20 May 2026 Qwen3.7-Max 59.2 Skillsbench
28 Apr 2026 Seed2.0 Lite (0428) 43.7 SkillsBench
22 Apr 2026 Qwen3.6 27B 48.2 SkillsBench Avg5 (OpenCode, 78 tasks)
20 Apr 2026 Qwen 3.6 Max (Preview) 55.6 SkillsBench Agent Skills
15 Apr 2026 Qwen 3.6 35B-A3B 28.7 SkillsBench Avg5
2 Apr 2026 Qwen 3.6 Plus 45.7 SkillsBench Avg5

2 system cards report it, from 2 labs

Besides launch posts, we read the system cards, model cards and technical reports labs publish with a release. They report far more, including safety and frontier-risk tests.

DateDocumentScoreAs the document writes itSection
19 Oct 2026 Muse Glimmer technical report 44.3 SkillsBench, high (Tables 2 and 5) Capabilities
23 Jun 2026 Seed2.1 Pro model card 60.4 SkillsBench, stated in the 2.3.2 text Capabilities

More in Terminal agents

All 18 in Terminal agents
  • Terminal-Bench 4.0 In use Agents complete 66 hard tasks in containerized terminals across software, ML, science, security, and operations. Test scripts verify each result, scored as resolution rate. Claude Opus 5.5 64.8%
  • Terminal-Bench Hard In use Agents complete 44 hard tasks from Terminal-Bench Core in the Terminus 2 harness. Artificial Analysis scores pass@1 averaged over 3 repeats. Gemma 4 31B IT 36%
  • Harbor-Index In use Agents solve about 80 hard tasks drawn from 29 benchmarks run through Harbor adapters, such as HLE, GSO and SWE-bench Pro. Each task keeps its source verifier. GPT-5.5 28.1%
  • CompileBench Not in model cards Agents build real open-source projects through dependency problems, legacy toolchains and complex build systems, for example compiling 22-year-old code. Claude Opus 4.1 100%
  • Long-Horizon-Terminal-Bench 2.0 Not in model cards Agents work for up to 3 hours per task on 77 container tasks, including 30 tasks that rebuild a scientific tool from its outputs. Hidden verifiers give partial-credit rewards. GPT-6 Astra 69.2%
  • ITBench Not in model cards Agents handle IT automation tasks in Kubernetes environments: site reliability incidents, compliance and security checks, and cloud cost work. Gemini 3 Pro 58.3%