CL-bench
Model must learn new knowledge from a supplied long context (rules, procedures, data) and solve tasks. Strict LLM-verified rubrics.
500 contexts, 1,899 tasks, 31,607 rubrics. Follow-up CL-bench Life (2026-04) covers everyday contexts.
In the authors’ words
Current language models (LMs) excel at reasoning over prompts using pre-trained knowledge. However, real-world tasks are far more complex and context-dependent: models must learn from task-specific context and leverage new knowledge beyond what is learned during pre-training to reason and resolve tasks. We term this capability context learning, a crucial ability that humans naturally possess but has been largely overlooked. To this end, we introduce CL-bench, a real-world benchmark consisting of 500 complex contexts, 1,899 tasks, and 31,607 verification rubrics, all crafted by experienced domain experts. Each task is designed such that the new content required to resolve it is contained within the corresponding context. Resolving tasks in CL-bench requires models to learn from the context, ranging from new domain-specific knowledge, rule systems, and complex procedures to laws derived from empirical data, all of which are absent from pre-training. This goes far beyond long-context tasks that primarily test retrieval or reading comprehension, and in-context learning tasks, where models learn simple task patterns via instructions and demonstrations. Our evaluations of ten frontier LMs find that models solve only 17.2% of tasks on average. Even the best-performing model, GPT-5.1, solves only 23.7%, revealing that LMs have yet to achieve effective context learning, which poses a critical bottleneck for tackling real-world, complex context-dependent tasks. CL-bench represents a step towards building LMs with this fundamental capability, making them more intelligent and advancing their deployment in real-world scenarios.
- Level
- University Undergraduates and entry-level professionals
- Scored
- Graded by a model A language model scores each response, usually against a rubric.
- Answers
- Open-ended Free-form text, documents, designs or media judged as a whole.
GPT-5.4 leads with 27.9% among models released by Apr 2026
Best score per entry from the benchmark's own leaderboard, read on 2 Nov 2026. Where a model ran with several settings or harnesses, we keep its best. Every run is in the next chart. Names in gray aren't in our model list: fine-tunes, agent systems, products and older models. They don't count toward leaders.
The newest model with a score here came out in Apr 2026, and nobody has tested a newer one. Among the 20 highest-ranked models on the capability index, these have no score yet:
- GPT-6 Astra
- Claude Opus 5.5
- GPT-6.1 Terra
- GPT-6.1 Sol
- and 16 more
- 27.9 GPT-5.4
- 23.7 GPT-5.1
- 23.4 Polyphony
- 22.8
Tencent Hy3 preview
- 22.2 Grok 4.20
- 21.1 Claude Opus 4.5
- 20.8
Gemini 3.1 Pro
- 20.7 Claude Opus 4.6
- 20.6 SEED 2.0 (high)
- 20.3
Qwen 3.6 Plus
- 19.8
Qwen 3.5 Plus (hosted 397B-A17B)
- 19.3 Kimi K2.5
- 18.7 SEED 2.0 (medium)
- 18.7 GLM-5
- 18.2 GPT-5.2
- 17.8 o3
- 17.6 Kimi K2 Thinking
- 17.2
Tencent HY 2.0 Think
- 16.1
Seed1.8
- 15.9 GLM-4.7
- 15.8
Gemini 3 Pro
- 15.7 MiMo-V2-Pro
- 15.0 Hy2.0
- 14.5
Qwen3-Max
- 13.4
Doubao-Seed-1.6
- 13.2
DeepSeek-V3.2
- 11.9 Kimi K2
- 11.4
MiniMax-M2.5
- 1 GPT-5.4 xhigh 27.9%
- 2 GPT-5.1 high 23.7%
- 3 Polyphony 23.4%
- 4
Tencent Hy3 preview 22.8%
- 5 Grok 4.20 reasoning 22.2%
- 6 Claude Opus 4.5 thinking 21.1%
- 7
Gemini 3.1 Pro high 20.8%
- 8 Claude Opus 4.6 20.7%
- 9 SEED 2.0 (high) 20.6%
- 10
Qwen 3.6 Plus 20.3%
- 11
Qwen 3.5 Plus (hosted 397B-A17B) thinking 19.8%
- 12 Kimi K2.5 19.3%
- 13 SEED 2.0 (medium) 18.7%
- 14 GLM-5 18.7%
- 15 GPT-5.2 18.2%
- 16 o3 high 17.8%
- 17 Kimi K2 Thinking 17.6%
- 18
Tencent HY 2.0 Think 17.2%
- 19
Seed1.8 16.1%
- 20 GLM-4.7 15.9%
- 21
Gemini 3 Pro high 15.8%
- 22 MiMo-V2-Pro 15.7%
- 23 Hy2.0 15%
- 24
Qwen3-Max 14.5%
- 25
Doubao-Seed-1.6 thinking 13.4%
- 26
DeepSeek-V3.2 thinking 13.2%
- 27 Kimi K2 Sep 2025 11.9%
- 28
MiniMax-M2.5 11.4%
| # | Entry | Score | Setting | Date | Source |
|---|---|---|---|---|---|
| 1 | GPT-5.4 | 27.9% | xhigh | Mar 2026 | Official leaderboard |
| 2 | GPT-5.1 | 23.7% | high | Nov 2025 | Official leaderboard |
| 3 | Polyphony | 23.4% | Official leaderboard | ||
| 4 | | 22.8% | Apr 2026 | Official leaderboard | |
| 5 | Grok 4.20 | 22.2% | reasoning | Feb 2026 | Official leaderboard |
| 6 | Claude Opus 4.5 | 21.1% | thinking | Nov 2025 | Official leaderboard |
| 7 | | 20.8% | high | Feb 2026 | Official leaderboard |
| 8 | Claude Opus 4.6 | 20.7% | Feb 2026 | Official leaderboard | |
| 9 | SEED 2.0 (high) | 20.6% | Official leaderboard | ||
| 10 | | 20.3% | Mar 2026 | Official leaderboard | |
| 11 | | 19.8% | thinking | Feb 2026 | Official leaderboard |
| 12 | Kimi K2.5 | 19.3% | Jan 2026 | Official leaderboard | |
| 13 | SEED 2.0 (medium) | 18.7% | Official leaderboard | ||
| 14 | GLM-5 | 18.7% | Feb 2026 | Official leaderboard | |
| 15 | GPT-5.2 | 18.2% | Dec 2025 | Official leaderboard | |
| 16 | o3 | 17.8% | high | Apr 2025 | Official leaderboard |
| 17 | Kimi K2 Thinking | 17.6% | Nov 2025 | Official leaderboard | |
| 18 | | 17.2% | Dec 2025 | Official leaderboard | |
| 19 | | 16.1% | Dec 2025 | Official leaderboard | |
| 20 | GLM-4.7 | 15.9% | Dec 2025 | Official leaderboard | |
| 21 | | 15.8% | high | Nov 2025 | Official leaderboard |
| 22 | MiMo-V2-Pro | 15.7% | Mar 2026 | Official leaderboard | |
| 23 | Hy2.0 | 15% | Official leaderboard | ||
| 24 | | 14.5% | Sep 2025 | Official leaderboard | |
| 25 | | 13.4% | thinking | Jun 2025 | Official leaderboard |
| 26 | | 13.2% | thinking | Dec 2025 | Official leaderboard |
| 27 | Kimi K2 Sep 2025 | 11.9% | Sep 2025 | Official leaderboard | |
| 28 | | 11.4% | Feb 2026 | Official leaderboard |
Epoch AI has scores for 20 models. Labs report scores for 6 models in their cards. We plot every source in the charts below.
Scores at each effort level
Models the leaderboard ran at two or more effort levels. We don’t have enough cost data here to say what the extra effort costs.
| Model | Effort | Harness | Score | Cost per task | Output tokens |
|---|---|---|---|---|---|
| GPT-5.4 | xhigh | 27.9% | |||
| GPT-5.1 | high | 23.7% | |||
| | 22.8% | ||||
| Grok 4.20 | reasoning | 22.2% | |||
| GPT-5.1 | 21.1% | ||||
| Claude Opus 4.5 | thinking | 21.1% | |||
| | high | 20.8% | |||
| Claude Opus 4.6 | 20.7% | ||||
| | 20.3% | ||||
| | thinking | 19.8% | |||
| Kimi K2.5 | 19.3% | ||||
| Claude Opus 4.5 | 19.1% | ||||
| GLM-5 | 18.7% | ||||
| GPT-5.2 | 18.2% | ||||
| GPT-5.2 | high | 18.1% | |||
| o3 | high | 17.8% | |||
| Grok 4.20 | non-reasoning | 17.7% | |||
| Kimi K2 Thinking | 17.6% | ||||
| | 17.2% | ||||
| | 16.1% | ||||
| GLM-4.7 | 15.9% | ||||
| | high | 15.8% | |||
| MiMo-V2-Pro | 15.7% | ||||
| | 14.8% | ||||
| | 14.5% | ||||
| | thinking | 14.1% | |||
| | thinking | 13.4% | |||
| | thinking | 13.2% | |||
| | 13.1% | ||||
| | 12.4% | ||||
| Kimi K2 Sep 2025 | 11.9% | ||||
| | 11.4% |
2 models have held number one since its release in Feb 2026
Lab claims count from the day the card came out, independent runs from the model’s release. We draw one row each for the benchmark’s own leaderboard, Epoch AI’s runs and what labs claim in their cards.
Scores over time
All the scores we have, one dot each, so a model tested at several settings appears more than once.
2 labs put it in a launch post in the last six months
Launch posts from every lab that has listed it, one tick per post. Tall colored ticks include it, and short gray ones leave it out.
| Date | Launch post | Score | As the post writes it |
|---|---|---|---|
| 2 Jul 2026 | 23.8 | CL-bench | |
| 1 Jun 2026 | 20.5 | CL-bench | |
| 28 Apr 2026 | 20.1 | CL-Bench | |
| 23 Apr 2026 | 22.8 | CL-bench | |
| 19 Mar 2026 | 12.2 | CL-Bench | |
| 14 Feb 2026 | 20.8 | CL-Bench |
2 system cards report it, from 2 labs
Besides launch posts, we read the system cards, model cards and technical reports labs publish with a release. They report far more, including safety and frontier-risk tests.
| Date | Document | Score | As the document writes it | Section |
|---|---|---|---|---|
| 19 Mar 2026 | | 12.2 | CL-Bench (Table 1) | Capabilities |
| 14 Feb 2026 | | 20.8 | CL-Bench (Table 3). Table 13 prints 21.5 | Capabilities |
More in Long context
- MRCR v2 In use Multi-round coreference: retrieve the n-th of several similar requests hidden in a long synthetic conversation, up to 1M tokens.
Muse Spark 1.3 98.5%
- LongBench v2 In use 503 multiple-choice questions over 8K-2M-word contexts (QA, dialogue, code repos, structured data). Accuracy. Beam 1.0 66.9%
- GraphWalks In use A graph is given as an edge list in long context. The model answers BFS or parent queries, scored by F1. Claude Fable 5 100%
- OpenAI MRCR v2 In use Models read a long synthetic chat that hides 2, 4 or 8 identical writing requests and must reproduce the response to the i-th one. Scored by mean string match ratio per context bin.
K-EXAONE 2.0 94.4%
- AA-LCR 1.1 In use Models answer 100 questions that need reasoning across sets of real documents of about 100K tokens. An LLM equality checker with a fixed system prompt compares each answer with the key.
Step 5 Preview 88.3%
- LOCA-Bench In use Agentic tasks whose environment state is scaled to grow context length while task semantics stay fixed. Success rate versus context length. GPT-5.2 21.3%