Benchmark Almanac

Seed-Coder-8B-Instruct

Seed-Coder-8B-Instruct places in the top three on BigCodeBench.

ByteDance Seed Released 8 May 2025 Family Seed-Coder The lab's model card
16
Benchmarks with a score
0
Ranked first, out of five or more models
1
In the top three
ByteDance Seed May 2025

Seed-Coder-8B-Instruct

Open weights Small

No Epoch Capabilities Index score yet
  • BigCodeBench 53.3% #3 /11
  • FullStackBench 55.8% #6 /6
  • AutoCodeBench 32.3% #27 /34

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Coding

BenchmarkScoreRankSource
MBPP 85.2% #9 of 66 Model card
BigCodeBench 53.3% #3 of 11 Model card
HumanEval 84.8% #43 of 95 Model card
NaturalCodeBench 49.6% #1 of 2 Model card
MBPP+ 71.2% #10 of 15 Model card
MBXP 75.3% #2 of 3 Model card
HumanEval+ 78.7% #20 of 27 Model card
AutoCodeBench 32.3% #27 of 34 Official leaderboard
Aider-Edit 57.1% #4 of 5 Model card
LiveCodeBench 24.7% #65 of 73 Model card
SWE-bench Verified 19.2% #148 of 150 Model card
FullStackBench 55.8% #6 of 6 Model card
BigCodeBench-Hard 26.4% #3 of 3 Model card
CanItEdit 50.5% #3 of 3 Model card
Multi-SWE-bench mini 4.00% #2 of 2 Model card
MHPP 36.2% #1 of 1 Model card

Its launch post

The benchmarks the lab chose to headline, with the scores it gave.

Its system card

Every result in the longer documents the lab published with it. 11 of them aren't in the launch post.