Benchmark Almanac

T5-11B

T5-11B ranks first on 2 of the 3 benchmarks it has scores on.

Google DeepMind Released 23 Oct 2019
7
Benchmarks with a score
2
Ranked first, out of five or more models
2
In the top three
Google DeepMind Oct 2019

T5-11B

Open weights

No Epoch Capabilities Index score yet
  • CommonsenseQA 2.0 67.8% #1 /6
  • SuperGLUE 88.9% #1 /8

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
SuperGLUE 88.9% #1 of 8 Epoch AI
CommonsenseQA 2.0 67.8% #1 of 6 Epoch AI
CB 96.8% #1 of 3 Official leaderboard
BoolQ 91.2% #2 of 3 Official leaderboard
WSC 93.8% #2 of 3 Official leaderboard
RTE 92.8% #1 of 1 Official leaderboard

Other

BenchmarkScoreRankSource
HELM Classic 13.1 #17 of 17 Official leaderboard