Benchmark Almanac

Tulu 3 (Tülu 3) 70B

Tulu 3 (Tülu 3) 70B.

Ai2 Released 21 Nov 2024
4
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Ai2 Nov 2024

Tulu 3 (Tülu 3) 70B

Open weights

No Epoch Capabilities Index score yet
  • GPQA Diamond 46.3% #162 /219
  • OTIS Mock AIME 2024-2025 4.44% #174 /202
  • MATH Level 5 42.7% #59 /94

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
LMArena (Elo) 1,286 #243 of 333 Official leaderboard

Math and science

BenchmarkScoreRankSource
MATH Level 5 42.7% #59 of 94 Epoch AI
GPQA Diamond 46.3% #162 of 219 Epoch AI
OTIS Mock AIME 2024-2025 4.44% #174 of 202 Epoch AI