Benchmark Almanac

T5-3B

T5-3B places in the top three on 3 benchmarks.

Google DeepMind Released 23 Oct 2019
5
Benchmarks with a score
0
Ranked first, out of five or more models
3
In the top three
Google DeepMind Oct 2019

T5-3B

Open weights

No Epoch Capabilities Index score yet
  • CommonsenseQA 2.0 60.2% #2 /6
  • SuperGLUE 86.4% #2 /8
  • Spider 78% #4 /5

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
BoolQ 89.9% #3 of 75 Epoch AI
SuperGLUE 86.4% #2 of 8 Epoch AI
CommonsenseQA 2.0 60.2% #2 of 6 Epoch AI

Coding

BenchmarkScoreRankSource
Spider 78% #4 of 5 Official leaderboard
Bird-SQL 24.1% #11 of 13 Official leaderboard