Benchmark Almanac

Granite-3.0-8B-Instruct

Granite-3.0-8B-Instruct.

IBM Released 21 Oct 2024 Family Granite 3.0 The lab's model card
4
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
IBM Oct 2024

Granite-3.0-8B-Instruct

Open weights Small

No Epoch Capabilities Index score yet
  • Vectara Hallucination Leaderboard (HHEM) 6.50% #43 /148
  • BigCodeBench-Hard 8.40% #87 /96

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
Vectara Hallucination Leaderboard (HHEM) 6.50% #43 of 148 Official leaderboard
LMArena (Elo) 1,183 #290 of 333 Official leaderboard

Coding

BenchmarkScoreRankSource
BigCodeBench 32.4% #59 of 69 Official leaderboard
BigCodeBench-Hard 8.40% #87 of 96 Official leaderboard