Benchmark Almanac

GLM-4-9B-Chat

GLM-4-9B-Chat places in the top three on SuperCLUE-Agent.

Z.ai Released 4 Jun 2024 Family GLM-4 The lab's model card
8
Benchmarks with a score
0
Ranked first, out of five or more models
1
In the top three
Z.ai Jun 2024

GLM-4-9B-Chat

Open weights Small

No Epoch Capabilities Index score yet
  • Vectara Hallucination Leaderboard (HHEM) 1.30% #139 /148
  • MMLU-CF 57.8% #23 /37
  • MathBench 47.7% #12 /21

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
WildBench 41.2 #25 of 47 Official leaderboard
MMLU-CF 57.8% #23 of 37 Official leaderboard
MMLU-Pro 48% #137 of 212 Official leaderboard
FaithJudge 25.4% #25 of 37 Official leaderboard
Vectara Hallucination Leaderboard (HHEM) 1.30% #139 of 148 Official leaderboard

Math and science

BenchmarkScoreRankSource
MathBench 47.7% #12 of 21 Official leaderboard

Agents and tools

BenchmarkScoreRankSource
SuperCLUE-Agent 69.6 #3 of 7 Official leaderboard
Berkeley Function Calling Leaderboard (BFCL) 39.1% #62 of 67 Official leaderboard