- Mean of TAU-bench-Retail / TAU-bench-Airline 70
- BFCL v3 (Full) 77.8
- BrowseComp 26.4
- MMLU Pro 84.6
- AIME24 91
- MATH 500 98.2
- SciCode 41.7
- GPQA 79.1
- HLE 14.4
- LiveCodeBench (2407-2501) 72.9
- AA-Index (Estimated) 67.7
- SWE-bench Verified 64.2
- SWE-Terminal-Bench (Terminal Bench) 37.5
GLM-4.5
GLM-4.5 places in the top three on 4 benchmarks.
74
Benchmarks with a score
0
Ranked first, out of five or more models
4
In the top three
Z.ai Aug 2025
GLM-4.5
Open weights Flagship
No Epoch Capabilities Index score yet
- Humanity's Last Exam 8.32% #31 /47
- SciCode 41.7% #26 /47
- MathArena (Apex, IMO, USAMO) 1.04% #37 /47
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| LLM Confabulation Leaderboard | 11.3% | #5 of 58 | Official leaderboard | |
| MMLU | 90% | #16 of 127 | Model card | |
| PIQA | 85.3% | #5 of 33 | Model card | |
| MMLU-Pro | 84.6% | #34 of 151 | Model card | |
| BIG-Bench Hard | 86.2% | #21 of 71 | Model card | |
| C3 | 83.1% | #2 of 6 | Model card | |
| SysBench | 81% | #2 of 6 | Model card | |
| HellaSwag | 87.1% | #16 of 47 | Model card | |
| LMArena (Elo) | 1,411 | #118 of 333 | Official leaderboard | |
| Wer wird Millionär? LLM Benchmark | 16000.0 | #29 of 76 | Official leaderboard | |
| LongBench v2 | 50.3% | #13 of 33 | Official leaderboard | |
| EQ-Bench 3 | 1,322 | #34 of 78 | Official leaderboard | |
| SimpleQA | 26.4% | #27 of 59 | Model card | |
| TriviaQA | 80% | #18 of 39 | Model card | |
| IFEval | 86.1% | #65 of 126 | Model card | |
| C-Eval | 86.9% | #23 of 38 | Model card | |
| Chinese SimpleQA | 70.1% | #8 of 13 | Model card | |
| Creative Writing v3 | 63.0 | #75 of 120 | Official leaderboard | |
| Vectara Hallucination Leaderboard (HHEM) | 3.70% | #94 of 148 | Official leaderboard | |
| Longform Creative Writing (EQ-Bench) | 55.5 | #77 of 119 | Official leaderboard | |
| Slop Score | 59.9 | #11 of 17 | Official leaderboard | |
| Humanity's Last Exam | 8.32% | #31 of 47 | Official leaderboard | |
| Judgemark v2.1 | 63.4 | #29 of 42 | Official leaderboard | |
| Lech Mazur Creative Writing | 7.34 | #33 of 44 | Epoch AI | |
| MultiChallenge | 52.8% | #27 of 36 | Model card | |
| BullshitBench | 14.6% | #82 of 107 | Official leaderboard | |
| MultiNRC | 17.4% | #33 of 38 | Official leaderboard | |
| CLUEWSC | 83.5% | #7 of 8 | Model card | |
| BullshitBench V2 | 8.00% | #112 of 122 | Official leaderboard | |
| Challenging translation human evaluation (Z.ai) | 1.71 | #1 of 1 | Model card |
Math and science
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MATH-500 | 98.2% | #4 of 67 | Model card | |
| AIME 2024 | 91% | #15 of 87 | Model card | |
| AIME 2025 | 93.3% | #11 of 53 | Official leaderboard | |
| AMO-Bench | 36.8% | #7 of 21 | Official leaderboard | |
| GPQA Diamond | 79.1% | #116 of 284 | Model card | |
| BRUMO 2025 | 92.5% | #18 of 42 | Official leaderboard | |
| PHYBench | 26% | #13 of 28 | Official leaderboard | |
| HMMT 2025 | 77.5% | #25 of 53 | Official leaderboard | |
| Novel logical reasoning problems expert evaluation (Z.ai) | 62.0 | #1 of 2 | Model card | |
| MATH | 61% | #53 of 93 | Model card | |
| SMT 2025 | 82.1% | #28 of 40 | Official leaderboard | |
| GSM8K | 79.4% | #62 of 87 | Model card | |
| CMIMC 2025 | 72.5% | #24 of 33 | Official leaderboard | |
| MathArena (Apex, IMO, USAMO) | 1.04% | #37 of 47 | Official leaderboard |
Coding
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| LiveCodeBench v5 | 72.9% | #5 of 44 | Model card | |
| LiveCodeBench | 72.9% | #23 of 73 | Model card | |
| AutoCodeBench | 46.6% | #12 of 34 | Official leaderboard | |
| ArtifactsBench | 51.3% | #8 of 20 | Official leaderboard | |
| SWE-bench Verified | 64.2% | #25 of 60 | Official leaderboard | |
| AlgoTune | 1.52× | #9 of 18 | Official leaderboard | |
| SciCode | 41.7% | #26 of 47 | Model card | |
| WeirdML | 40.6% | #76 of 112 | Official leaderboard | |
| EvalPlus | 78.1% | #5 of 6 | Model card | |
| IOI (Vals) | 2.92% | #47 of 55 | Official leaderboard | |
| ALE-Bench | 345 | #108 of 121 | Epoch AI |
Agents and tools
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| Berkeley Function Calling Leaderboard (BFCL) | 77.8% | #4 of 47 | Model card | |
| tau-bench | 70.1% | #3 of 23 | Model card | |
| Elimination Game | 4 | #27 of 56 | Official leaderboard | |
| LisanBench | 400.3 | #71 of 133 | Official leaderboard | |
| CompileBench | 73.3% | #11 of 20 | Official leaderboard | |
| VitaBench 2.0 | 36.4% | #11 of 20 | Official leaderboard | |
| Step Race | 2 | #33 of 59 | Official leaderboard | |
| MCP-Universe | 24.7% | #17 of 30 | Official leaderboard | |
| Terminal-Bench | 37.5% | #15 of 22 | Model card | |
| MCPMark | 15.6% | #22 of 28 | Official leaderboard | |
| SnakeBench | 17 | #156 of 183 | Official leaderboard | |
| BrowseComp | 26.4% | #76 of 77 | Model card |
Professional work
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| StockBench | 2.30% | #3 of 13 | Official leaderboard | |
| TaxEval v2 | 72.4% | #61 of 129 | Official leaderboard | |
| CorpFin v2 | 61% | #62 of 119 | Official leaderboard | |
| LegalBench | 75.6% | #105 of 138 | Official leaderboard |
Safety and security
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| SafetyBench | 89.9% | #1 of 2 | Model card | |
| FORTRESS | 59.6% | #61 of 66 | Official leaderboard |
Other
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| Artificial Analysis Intelligence Index v2 | 67.7 | #1 of 2 | Model card |
Its launch post
The benchmarks the lab chose to headline, with the scores it gave.
Its system card
Every result in the longer documents the lab published with it. 22 of them aren't in the launch post.
Capabilities
- tau-bench 70.1
- Berkeley Function Calling Leaderboard (BFCL) 77.8
- BrowseComp 26.4
- MMLU-Pro 84.6
- AIME 2024 91
- MATH-500 98.2
- SciCode 41.7
- GPQA Diamond 79.1
- Humanity's Last Exam 14.4
- LiveCodeBench v5 72.9
- Artificial Analysis Intelligence Index v2 67.7
- SWE-bench Verified 64.2
- Terminal-Bench 37.5
- MMLU 90
- IFEval 86.1
- SysBench 81
- MultiChallenge 52.8
- Novel logical reasoning problems expert evaluation (Z.ai) 62
- Real-scenario prompts human evaluation (Z.ai)
- CC-Bench
- Challenging translation human evaluation (Z.ai) 1.71
- BIG-Bench Hard 86.2
- HellaSwag 87.1
- PIQA 85.3
- TriviaQA 80
- EvalPlus 78.1
- GSM8K 79.4
- MATH 61
- CLUEWSC 83.5
- C-Eval 86.9
- C3 83.1
Hallucination
- SimpleQA 26.4
- Chinese SimpleQA 70.1
Safety
- SafetyBench 89.9