Benchmark Almanac

Granite-3.1-2B-Instruct

Granite-3.1-2B-Instruct.

IBM Released 18 Dec 2024 Family Granite 3.1 The lab's model card
4
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
IBM Dec 2024

Granite-3.1-2B-Instruct

Open weights Small

No Epoch Capabilities Index score yet
  • Vectara Hallucination Leaderboard (HHEM) 15.7% #10 /148

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
Vectara Hallucination Leaderboard (HHEM) 15.7% #10 of 148 Official leaderboard
MMLU-Pro 32% #178 of 212 Official leaderboard
LMArena (Elo) 1,179 #293 of 333 Official leaderboard
SuperGPQA 17.9% #56 of 58 Official leaderboard