WebArena-Verified
Muse Spark 1.1 69% leads since Jul 2026 In use Agents complete 812 audited WebArena tasks on self-hosted websites. Deterministic evaluators check the agent's answer and captured network traces.
It fixes WebArena's tasks, answers, and evaluators and drops LLM judges. A 258 task Hard subset also exists.
- Level
- Everyday Most adults, without training
- Scored
- Checked automatically A program checks the result against an answer key, unit tests or the expected final state.
- Answers
- Agent task Many steps in a terminal, browser, desktop, app, game or robot.
Muse Spark 1.1 leads with 69%
Best score per model as labs report them in their own cards. Labs pick their own settings, so these compare less cleanly than independent runs.
- 1 Muse Spark 1.1 69%
- 2
Qwen 3.8 Max 66.8% - 3 Claude Sonnet 4.6 66.4%
- 4 Qwen 3.8 27B 64.8%
- 5 LFM3-1.7B 38.4%
- 6 LFM2.5-24B-A2B 26.8%
| # | Model | Score | Setting | Date | Source |
|---|---|---|---|---|---|
| 1 | Muse Spark 1.1 | 69% | Jul 2026 | Model card | |
| 2 | Qwen 3.8 Max | 66.8% | Aug 2026 | Model card | |
| 3 | Claude Sonnet 4.6 | 66.4% | Feb 2026 | Model card | |
| 4 | Qwen 3.8 27B | 64.8% | Aug 2026 | Model card | |
| 5 | LFM3-1.7B | 38.4% | Oct 2026 | Model card | |
| 6 | LFM2.5-24B-A2B | 26.8% | Oct 2026 | Model card |
2 models have held number one since its release in Dec 2025
Lab claims count from the day the card came out, independent runs from the model’s release.
Scores over time
All the scores we have, one dot each, so a model tested at several settings appears more than once.
2 labs put it in a launch post in the last six months
Launch posts from every lab that has listed it, one tick per post. Tall colored ticks include it, and short gray ones leave it out.
| Date | Launch post | Score | As the post writes it |
|---|---|---|---|
| 27 Oct 2026 | LFM3-1.7B | 38.4 | WebArena-Verified |
| 13 Oct 2026 | LFM2.5-24B-A2B | 26.8 | WebArena Verified |
| 14 Aug 2026 | Qwen 3.8 27B | 64.8 | Browser use WebArena-Verified (OSWorld scaffold) |
| 3 Aug 2026 | Qwen 3.8 Max | 66.8 | WebArena-Verified |
2 system cards report it, from 2 labs
Besides launch posts, we read the system cards, model cards and technical reports labs publish with a release. They report far more, including safety and frontier-risk tests.
| Date | Document | Score | As the document writes it | Section |
|---|---|---|---|---|
| 9 Jul 2026 | Muse Spark 1.1 system card | 69 | WebArena-Verified pass@1, 812 tasks (Figure 44) | Capabilities |
| 17 Feb 2026 | Claude Sonnet 4.6 system card | 66.4 | WebArena-Verified full set, pass@1 Average@5, value printed on chart; hard subset 67.7 (Figure 2.18.2.A) | Capabilities |
More in Computer and browser use
- BrowseComp In use Hard-to-find facts that need persistent web browsing. Short verifiable answers graded for exact correctness. Claude Fable 5 93.3%
- ScreenSpot-Pro In use GUI grounding on high-resolution professional-software screenshots. The model must locate the target UI element. GPT-6 Astra 92.7%
- AndroidWorld In use Agents complete 116 tasks across 20 real Android apps in an emulator. Each task checks the device's system state to judge success. GPT-6 Astra 100%
- OSWorld 2.1 In use Agents complete 108 long-horizon workflows across 31 self-hosted websites and desktop apps, averaging 318 tool calls. Scored by binary completion and checkpoint partial credit. Claude Opus 5.5 81.8%
- MobileWorld In use Agents complete 201 tasks across 20 mobile apps, including tasks that need user clarification or MCP tools. Backend checks verify success. Kimi K3 74.4%
- RecreationBench In use Agents explore a running reference app and rebuild it, across 250 tasks on five platforms. Programmatic tests and a VLM judge score the result. GPT-6 Astra 58.1%