Benchmark Almanac

GLM-4.5-Air

GLM-4.5-Air places in the top three on SysBench.

Z.ai Released 20 Jul 2025
46
Benchmarks with a score
0
Ranked first, out of five or more models
1
In the top three
Z.ai Jul 2025

GLM-4.5-Air

Open weights

No Epoch Capabilities Index score yet
  • Humanity's Last Exam 8.12% #33 /47
  • SciCode 37.3% #36 /47
  • LiveCodeBench v5 70.7% #11 /44

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
MMLU 87.4% #35 of 127 Model card
MMLU-Pro 81.4% #62 of 151 Model card
Vectara Hallucination Leaderboard (2025 dataset) 9.30% #49 of 104 Official leaderboard
LMArena (Elo) 1,373 #158 of 333 Official leaderboard
IFEval 86.3% #62 of 126 Model card
SysBench 77.4% #3 of 6 Model card
LongBench v2 48.6% #18 of 33 Official leaderboard
Wer wird Millionär? LLM Benchmark 1867.0 #45 of 76 Official leaderboard
Humanity's Last Exam 8.12% #33 of 47 Official leaderboard
SimpleQA 14.5% #42 of 59 Model card
Vectara Hallucination Leaderboard (HHEM) 1.90% #129 of 148 Official leaderboard
MultiChallenge 42.5% #32 of 36 Model card
MultiNRC 10.4% #36 of 38 Official leaderboard

Math and science

BenchmarkScoreRankSource
MATH-500 98.1% #5 of 67 Model card
AIME 2024 89.4% #21 of 87 Model card
ForecastBench 61.6 #31 of 86 Official leaderboard
GPQA Diamond 75% #141 of 284 Model card
BRUMO 2025 90% #23 of 42 Official leaderboard
AIME 2025 83.3% #31 of 53 Official leaderboard
HMMT 2025 69.2% #31 of 53 Official leaderboard
CMIMC 2025 71.9% #25 of 33 Official leaderboard
SMT 2025 77.4% #32 of 40 Official leaderboard
Novel logical reasoning problems expert evaluation (Z.ai) 53.4 #2 of 2 Model card

Coding

BenchmarkScoreRankSource
LiveCodeBench v5 70.7% #11 of 44 Model card
ArtifactsBench 48.9% #11 of 20 Official leaderboard
AutoCodeBench 40.8% #22 of 34 Official leaderboard
SWE-bench Verified 57.6% #113 of 150 Model card
SciCode 37.3% #36 of 47 Model card
GSO-Bench 2.94% #28 of 30 Official leaderboard

Agents and tools

BenchmarkScoreRankSource
Berkeley Function Calling Leaderboard (BFCL) 76.4% #8 of 47 Model card
Galileo Agent Leaderboard v2 44% #9 of 21 Official leaderboard
PinchBench 69.4% #24 of 48 Official leaderboard
SnakeBench 24 #93 of 183 Official leaderboard
LisanBench 238.7 #85 of 133 Official leaderboard
ClawBench V2 2.30% #5 of 7 Official leaderboard
MCP-Universe 19.5% #26 of 30 Official leaderboard
Terminal-Bench 30% #21 of 22 Model card
BrowseComp 21.3% #77 of 77 Model card

Safety and security

BenchmarkScoreRankSource
SimpleSafetyTests 99% #38 of 75 Official leaderboard
Anthropic Red Team 99% #39 of 75 Official leaderboard
HELM Safety 90.1 #47 of 75 Official leaderboard
AIR-Bench 2024 57.1% #56 of 82 Official leaderboard
FORTRESS 63.2% #65 of 66 Official leaderboard
SafetyBench 87.8% #2 of 2 Model card

Other

BenchmarkScoreRankSource
HELM Capabilities 67.0 #28 of 60 Official leaderboard
Artificial Analysis Intelligence Index v2 64.8 #2 of 2 Model card

Its system card

Every result in the longer documents the lab published with it. 20 of them aren't in the launch post.

Hallucination

Safety