Benchmark Almanac

Seed-Thinking-v1.5

Seed-Thinking-v1.5.

ByteDance Seed Released 10 Apr 2025 Family Seed 1 The lab's model card
14
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
ByteDance Seed Apr 2025

Seed-Thinking-v1.5

Closed weights Flagship

No Epoch Capabilities Index score yet
  • SuperGPQA 62.1% #16 /26
  • LiveCodeBench v5 64.9% #17 /44
  • MMLU-Pro 87% #10 /151

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
MMLU-Pro 87% #10 of 151 Model card
IFEval 87.4% #53 of 126 Model card
COLLIE 73.1% #6 of 12 Model card
SuperGPQA 62.1% #16 of 26 Model card
SimpleQA 12.9% #45 of 59 Model card

Math and science

BenchmarkScoreRankSource
PolyMath 47.2% #4 of 38 Official leaderboard
AIME 2024 86.7% #28 of 87 Model card
GPQA Diamond 77.3% #125 of 284 Model card
AIME 2025 74% #103 of 143 Model card
Beyond AIME 48% #12 of 14 Model card
ARC-AGI 39.9% #19 of 19 Model card

Coding

BenchmarkScoreRankSource
LiveCodeBench v5 64.9% #17 of 44 Model card
Aider Polyglot 54.2% #17 of 29 Model card
SWE-bench Verified 47% #130 of 150 Model card

Its launch post

The benchmarks the lab chose to headline, with the scores it gave.

Its system card

Every result in the longer documents the lab published with it.