Qwen3-Coder-480B-A35B places in the top three on Bird-SQL.
Qwen Released 31 Jul 2025 Qwen Jul 2025 Open weights
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| LMArena (Elo) | 1,388 | #145 of 333 | Official leaderboard | |
| BullshitBench | 20% | #69 of 107 | Official leaderboard | |
| BullshitBench V2 | 20% | #87 of 122 | Official leaderboard |
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| Bird-SQL | 68.1% | #3 of 13 | Official leaderboard | |
| SWE-bench Verified | 69.6% | #16 of 60 | Official leaderboard | |
| LiveSQLBench | 26.8% | #14 of 36 | Official leaderboard | |
| AutoCodeBench | 44.8% | #16 of 34 | Official leaderboard | |
| Aider Polyglot | 61.8% | #14 of 29 | Model card | |
| Multi-SWE-bench mini | 25.8% | #1 of 2 | Model card | |
| SWE-Bench Pro | 38.7% | #13 of 24 | Official leaderboard | |
| SWE-bench-Live | 24.7% | #8 of 13 | Official leaderboard | |
| WeirdML | 41.2% | #72 of 112 | Official leaderboard | |
| ArtifactsBench | 47.1% | #14 of 20 | Official leaderboard | |
| AlgoTune | 1.44× | #13 of 18 | Official leaderboard | |
| GSO-Bench | 4.90% | #23 of 30 | Official leaderboard | |
| ALE-Bench | 461 | #101 of 121 | Epoch AI | |
| Code Arena | 1,275 | #107 of 124 | Official leaderboard | |
| WebDev Arena | 1,274 | #92 of 105 | Epoch AI | |
| SWE-bench Multilingual | 54.7% | #64 of 70 | Model card | |
| OpenHands Index | 30.9% | #33 of 33 | Official leaderboard | |
| CodeClash | 952 | #8 of 8 | Official leaderboard | |
| Multi-SWE-bench flash | 27% | #1 of 1 | Model card | |
| Spider 2.0 | 31.1% | #1 of 1 | Model card |
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| tau-bench | 68.8% | #6 of 23 | Model card | |
| MCPMark | 24.8% | #12 of 28 | Official leaderboard | |
| Berkeley Function Calling Leaderboard (BFCL) | 68.7% | #27 of 47 | Model card | |
| SnakeBench | 21 | #111 of 183 | Official leaderboard | |
| Terminal-Bench | 27.2% | #11 of 18 | Epoch AI | |
| MCP-Universe | 22.9% | #19 of 30 | Official leaderboard | |
| LisanBench | 213.7 | #87 of 133 | Official leaderboard | |
| Pencil Puzzle Bench | 0% | #36 of 53 | Official leaderboard | |
| Terminal-Bench 2.0 | 27.2% | #35 of 43 | Official leaderboard | |
| Toolathlon | 14.5% | #45 of 50 | Official leaderboard | |
| WebArena | 49.9% | #8 of 8 | Model card | |
| Mind2Web | 55.8% | #1 of 1 | Model card |
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| Physical-Engineering's Last Exam | 0.06 | #12 of 18 | Official leaderboard | |
| StockBench | 0.20% | #11 of 13 | Official leaderboard |
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| BaxBench | 37.2% | #11 of 34 | Official leaderboard |
The benchmarks the lab chose to headline, with the scores it gave.