Terminal-Bench Challenges
Not in model cards
Agents build a large project end to end with no time limit, such as a faster Rust compiler or a WebGL renderer in WebAssembly. Each challenge has its own test bed and metric.
Three challenges at launch: Rust compiler speedup, inference engine codegolf and WASM WebGL renderer. Submissions must share the artifact and full agent logs.
Made by Terminal-Bench team (Stanford, Harbor and Laude Institute) Released Jun 2026 Long terminal sessions All tasks public
- Level
- Research frontier Researchers, on open problems or tasks that take days
- Scored
- Checked automatically A program checks the result against an answer key, unit tests or the expected final state.
- Answers
- Agent task Many steps in a terminal, browser, desktop, app, game or robot.
No scores here yet
No lab, leaderboard or Epoch AI run has reported a score for Terminal-Bench Challenges yet.
No lab model card reports it yet
We read the headline results of 479 launch posts from 51 labs, and none of them list this benchmark.
More in Terminal agents
- Terminal-Bench 4.0 In use Agents complete 66 hard tasks in containerized terminals across software, ML, science, security, and operations. Test scripts verify each result, scored as resolution rate. Claude Opus 5.5 64.8%
- SkillsBench In use 86-87 containerized expert tasks in 11 domains, run with and without Agent Skills. Verifier tests give pass rate and skill lift. GPT-5.5 67.3%
- Terminal-Bench Hard In use Agents complete 44 hard tasks from Terminal-Bench Core in the Terminus 2 harness. Artificial Analysis scores pass@1 averaged over 3 repeats.
Gemma 4 31B IT 36% - Harbor-Index In use Agents solve about 80 hard tasks drawn from 29 benchmarks run through Harbor adapters, such as HLE, GSO and SWE-bench Pro. Each task keeps its source verifier. GPT-5.5 28.1%
- CompileBench Not in model cards Agents build real open-source projects through dependency problems, legacy toolchains and complex build systems, for example compiling 22-year-old code. Claude Opus 4.1 100%
- Long-Horizon-Terminal-Bench 2.0 Not in model cards Agents work for up to 3 hours per task on 77 container tasks, including 30 tasks that rebuild a scientific tool from its outputs. Hidden verifiers give partial-credit rewards. GPT-6 Astra 69.2%