- AIME-25 94.3
- HMMT25(Feb) 89.7
- BeyondAIME 77
- AMO-Bench 60
- IMO-AnswerBench (w/ code tools) 76.3
- AetherCode 38.2
- LiveCodeBench(v6) 79.5
- LiveCodeBench pro 1930
- GPQA-Diamond 83.8
- PHYBench 41
- BIOBench (internal) 42.3
- KOR-Bench 76.2
- ARC-AGI-1 67.9
- Inverse IFEval 80.3
- MARS-Bench 70.1
- MultiChallenge 66.7
- Collie-Hard 72.6
- EIFBench 48.6
- MMLU 92.3
- MMLU-pro 84.9
- SuperGPQA 64.8
- LPFQA 49.1
- BrowseComp-en 67.6
- BrowseComp-zh 81.3
- GAIA 87.4
- WideSearch 63.8
- HLE(text-only), agentic search 40.9
- MM-BrowseComp 46.3
- HLE-VL 31.5
- SWE-Bench Verified 72.9
- Multi-SWE-Bench 42
- AInstein-SWE-Bench 36.7
- Terminal Bench 2.0 45.2
- U-Artifacts 49.2
- BFCL-v4 57.2
- τ2-Bench 72
- DeepConsult 41
- DeepResearchBench 43.5
- DiscoX 74.6
- FinSearchComp(T2&T3) 62.8
- Mean of XpertBench Law 55.2 / Fin 62.0 / Edu 47.9 / Research 31.4 / Humanities 60.2 51.3
- WorldTravel multi-modal (best of 5) 47.2 / text 52.1 47.2
- OSWorld 61.9
- Online-Mind2web 85.9
- AndroidWorld 70.7
- MMMU 83.4
- MMMU-Pro 73.2
- MathVista 87.7
- MathVision 81.3
- DynaMath 61.5
- LogicVista 78.3
- ZeroBench (main) 11
- VPCT 61
- VLMsAreBiased 62
- VLMsAreBlind 93
- SimpleVQA 65.4
- HallusionBench 63.9
- MMStar 79.9
- MMBench v1.1 EN (CN 90.6) 91.6
- MUIRBench 78.7
- MMVP 86
- ScreenSpot-Pro 64.3 / 73.1 with crop-box tool 73.1
- CountBench 96.3
- BLINK 74.3
- RefSpatialBench 56.3
- ERQA 58.8
- CV-Bench 88
- AI2D 89.1
- CharXiv (RQ) 71.4
- DUDE 69.4
- Mean of MMLB-NIAH (128k) 72.2 / MMLB-VRAG (128k) 83.2 77.7
- VideoMMMU 82.7
- MMVU 73.1
- VideoHolmes (with subtitles) 65.5
- Minerva 62.4
- VideoSimpleQA 67.8
- TVBench 71.5
- TempCompass 86.9
- TOMATO 60.8
- EgoTempo 67
- MotionBench 70.6
- VideoMME (with subtitles) 87.8
- LongVideoBench 77.4
- LVBench 73
- OVBench 65.1
- OVOBench 72.6
- StreamingBench (proactive) 84.4
- OmniDocBench 1.5 (normalized edit distance, lower is better) 0.106
- SFE 51.2
- EMMA 60.9
- MME-CC 43.4
- Point-Bench 76.5
- MMSIBench (circular) 25.8
- VCRBench 59.8
- VideoReasonBench 52.8
- CGBench 62.4
- LiveSports-3K 77.5
- ViSpeak 79
- OmniMMI (proactive) 53
- Education 60.8
- Customer Support Q&A 69
- Information Processing 53.9
- Intention Recognition 63.2
- Information Extraction 43.7
- Complex Workflow 54.6
Seed1.8
Seed1.8 ranks first on 3 of the 75 benchmarks it has scores on.
113
Benchmarks with a score
3
Ranked first, out of five or more models
15
In the top three
ByteDance Seed Dec 2025 Seed1.8
Closed weights Flagship
No Epoch Capabilities Index score yet
- MMMU-Pro 73.2% #40 /72
- BFCL V4 57.2% #19 /24
- SimpleVQA 65.4% #13 /23
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MMLU | 92.3% | #1 of 127 | Model card | |
| MMLU-Pro | 84.9% | #31 of 151 | Model card | |
| MultiChallenge | 66.7% | #9 of 36 | Model card | |
| Inverse IFEval | 80.3% | #1 of 3 | Model card | |
| Humanity's Last Exam | 40.9% | #58 of 147 | Model card | |
| SuperGPQA | 64.8% | #13 of 26 | Model card | |
| MMLongBench | 77.7% | #2 of 4 | Model card | |
| HallusionBench | 63.9% | #12 of 23 | Model card | |
| SimpleVQA | 65.4% | #13 of 23 | Model card | |
| COLLIE | 72.6% | #7 of 12 | Model card | |
| CL-bench | 16.1% | #16 of 24 | Official leaderboard | |
| WideSearch | 63.8% | #14 of 17 | Model card | |
| Video SimpleQA | 67.8% | #4 of 4 | Model card | |
| Complex Workflow (ByteDance Seed in-house) | 54.6% | #2 of 2 | Model card | |
| DiscoX | 74.6% | #2 of 2 | Model card | |
| LPFQA | 49.1% | #2 of 2 | Model card | |
| MARS-Bench | 70.1% | #2 of 2 | Model card | |
| EIFBench | 48.6% | #1 of 1 | Model card |
Math and science
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| AIME 2025 | 94.3% | #25 of 143 | Model card | |
| Beyond AIME | 77% | #4 of 14 | Model card | |
| GPQA Diamond | 83.8% | #85 of 284 | Model card | |
| HMMT 2025 | 89.7% | #22 of 49 | Model card | |
| AMO-Bench | 60% | #2 of 4 | Model card | |
| KOR-Bench | 76.2% | #2 of 4 | Model card | |
| ARC-AGI | 67.9% | #12 of 19 | Model card | |
| PHYBench | 41% | #4 of 5 | Model card | |
| IMO-AnswerBench | 76.3% | #31 of 37 | Model card |
Coding
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| SWE-bench Verified | 72.9% | #59 of 150 | Model card | |
| LiveCodeBench v6 | 79.5% | #30 of 76 | Model card | |
| Multi-SWE-bench | 42% | #5 of 10 | Model card | |
| LiveCodeBench Pro | 1,930 | #4 of 4 | Model card | |
| AetherCode | 38.2% | #3 of 3 | Model card | |
| AInstein-SWE-Bench | 36.7% | #2 of 2 | Model card | |
| U-Artifacts | 49.2% | #1 of 1 | Model card |
Agents and tools
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| BrowseComp-ZH | 81.3% | #2 of 17 | Model card | |
| OSWorld | 61.9% | #2 of 12 | Model card | |
| GAIA | 87.4% | #1 of 5 | Model card | |
| GameWorld | 39.8% | #3 of 12 | Official leaderboard | |
| Online-Mind2Web | 85.9% | #2 of 8 | Model card | |
| AndroidWorld | 70.7% | #7 of 18 | Model card | |
| ScreenSpot-Pro | 73.1% | #10 of 25 | Model card | |
| LisanBench | 1087.3 | #55 of 133 | Official leaderboard | |
| OSWorld-Verified | 61.9% | #15 of 33 | Official leaderboard | |
| MobileWorld | 52.1% | #10 of 18 | Official leaderboard | |
| MM-BrowseComp | 46.3% | #3 of 5 | Model card | |
| BrowseComp | 67.6% | #47 of 77 | Model card | |
| VITA-Bench | 18.8% | #11 of 18 | Official leaderboard | |
| tau2-bench | 72% | #50 of 69 | Model card | |
| Terminal-Bench 2.0 | 45.2% | #47 of 61 | Model card | |
| BFCL V4 | 57.2% | #19 of 24 | Model card | |
| Customer Support Q&A (ByteDance Seed in-house) | 69% | #2 of 2 | Model card | |
| DeepConsult | 41% | #2 of 2 | Model card | |
| DeepResearch Bench | 43.5% | #2 of 2 | Model card | |
| WorldTravel | 47.2% | #1 of 1 | Model card |
Professional work
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| FinSearchComp | 62.8% | #6 of 7 | Model card | |
| XpertBench | 51.3% | #3 of 3 | Model card | |
| Education (ByteDance Seed in-house) | 60.8% | #2 of 2 | Model card | |
| Information Extraction (ByteDance Seed in-house) | 43.7% | #2 of 2 | Model card | |
| Information Processing (ByteDance Seed in-house) | 53.9% | #1 of 1 | Model card | |
| Intention Recognition (ByteDance Seed in-house) | 63.2% | #1 of 1 | Model card |
Vision, audio and robotics
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MathVista | 87.7% | #5 of 64 | Model card | |
| MMMU | 83.4% | #8 of 97 | Model card | |
| CVBench | 88% | #1 of 11 | Model card | |
| BLINK | 74.3% | #4 of 28 | Model card | |
| Video-MME | 87.8% | #7 of 42 | Model card | |
| MMStar | 79.9% | #7 of 30 | Model card | |
| LogicVista | 78.3% | #3 of 12 | Model card | |
| MuirBench | 78.7% | #3 of 12 | Model card | |
| TempCompass | 86.9% | #2 of 7 | Model card | |
| CountBench | 96.3% | #6 of 20 | Model card | |
| StreamingBench | 84.4% | #1 of 3 | Model card | |
| MMBench-EN v1.1 | 91.6% | #6 of 17 | Model card | |
| MMVP | 86% | #2 of 5 | Model card | |
| MATH-Vision (MathVision) | 81.3% | #17 of 42 | Model card | |
| AI2D | 89.1% | #18 of 44 | Model card | |
| MotionBench | 70.6% | #4 of 9 | Model card | |
| MMVU | 73.1% | #9 of 20 | Model card | |
| LongVideoBench | 77.4% | #5 of 11 | Model card | |
| VLMs Are Blind | 93% | #4 of 8 | Model card | |
| Video-MMMU | 82.7% | #16 of 30 | Model card | |
| MMMU-Pro | 73.2% | #40 of 72 | Model card | |
| DynaMath | 61.5% | #10 of 17 | Model card | |
| LVBench | 73% | #15 of 25 | Model card | |
| EgoTempo | 67% | #3 of 5 | Model card | |
| OVBench | 65.1% | #3 of 5 | Model card | |
| TOMATO | 60.8% | #3 of 5 | Model card | |
| ERQA | 58.8% | #17 of 26 | Model card | |
| BabyVision | 30.2% | #18 of 27 | Official leaderboard | |
| Video-Holmes | 65.5% | #4 of 6 | Model card | |
| Point-Bench | 76.5% | #2 of 3 | Model card | |
| ViSpeak-Bench | 79% | #2 of 3 | Model card | |
| CharXiv | 71.4% | #50 of 67 | Model card | |
| DUDE | 69.4% | #3 of 4 | Model card | |
| LiveSports-3K | 77.5% | #3 of 4 | Model card | |
| ZeroBench | 11% | #20 of 25 | Model card | |
| OVO-Bench | 72.6% | #4 of 5 | Model card | |
| Scientists' First Exam (SFE) | 51.2% | #4 of 5 | Model card | |
| MINERVA | 62.4% | #5 of 6 | Model card | |
| TVBench | 71.5% | #6 of 7 | Model card | |
| RefSpatial-Bench | 56.3% | #7 of 8 | Model card | |
| OmniDocBench v1.5 | 0.11 | #12 of 13 | Model card | |
| MMSI-Bench | 25.8% | #5 of 5 | Model card | |
| VLMsAreBiased | 62% | #5 of 5 | Model card | |
| CG-Bench | 62.4% | #3 of 3 | Model card | |
| EMMA | 60.9% | #3 of 3 | Model card | |
| HLE-VL | 31.5% | #3 of 3 | Model card | |
| VideoReasonBench | 52.8% | #3 of 3 | Model card | |
| MME-CC | 43.4% | #2 of 2 | Model card | |
| VPCT | 61% | #2 of 2 | Model card | |
| ZeroVideo | 6.90% | #2 of 2 | Model card | |
| OmniMMI | 53% | #1 of 1 | Model card | |
| VCR-Bench | 59.8% | #1 of 1 | Model card |
Safety and security
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| BIOBench (ByteDance Seed) | 42.3% | #2 of 2 | Model card |
Its launch post
The benchmarks the lab chose to headline, with the scores it gave.
Its system card
Every result in the longer documents the lab published with it. 3 of them aren't in the launch post.
Capabilities
- AIME 2025 94.3
- HMMT 2025 89.7
- Beyond AIME 77
- AMO-Bench 60
- IMO-AnswerBench 76.3
- AetherCode 38.2
- LiveCodeBench v6 79.5
- LiveCodeBench Pro 1930
- GPQA Diamond 83.8
- PHYBench 41
- BIOBench (ByteDance Seed) 42.3
- KOR-Bench 76.2
- ARC-AGI 67.9
- Inverse IFEval 80.3
- MARS-Bench 70.1
- MultiChallenge 66.7
- COLLIE 72.6
- EIFBench 48.6
- MMLU 92.3
- MMLU-Pro 84.9
- SuperGPQA 64.8
- LPFQA 49.1
- Education (ByteDance Seed in-house) 60.8
- Customer Support Q&A (ByteDance Seed in-house) 69
- Information Processing (ByteDance Seed in-house) 53.9
- Intention Recognition (ByteDance Seed in-house) 63.2
- Information Extraction (ByteDance Seed in-house) 43.7
- Complex Workflow (ByteDance Seed in-house) 54.6
- MMMU 83.4
- MMMU-Pro 73.2
- MathVista 87.7
- MATH-Vision (MathVision) 81.3
- DynaMath 61.5
- LogicVista 78.3
- EMMA 60.9
- Scientists' First Exam (SFE) 51.2
- ZeroBench 11
- VPCT 61
- VLMsAreBiased 62
- VLMs Are Blind 93
- SimpleVQA 65.4
- HallusionBench 63.9
- MMStar 79.9
- MMBench-EN v1.1 91.6
- MME-CC 43.4
- MuirBench 78.7
- MMVP 86
- ScreenSpot-Pro 64.3
- CountBench 96.3
- Point-Bench 76.5
- BLINK 74.3
- MMSI-Bench 25.8
- RefSpatial-Bench 56.3
- ERQA 58.8
- CVBench 88
- AI2D 89.1
- OmniDocBench v1.5 0.106
- CharXiv 71.4
- DUDE 69.4
- MMLongBench
- Video-MMMU 82.7
- MMVU 73.1
- VCR-Bench 59.8
- VideoReasonBench 52.8
- Video-Holmes 65.5
- MINERVA 62.4
- Video SimpleQA 67.8
- TVBench 71.5
- TempCompass 86.9
- TOMATO 60.8
- EgoTempo 67
- MotionBench 70.6
- Video-MME 87.8
- CG-Bench 62.4
- LongVideoBench 77.4
- LVBench 73
- OVBench 65.1
- LiveSports-3K 77.5
- OVO-Bench 72.6
- ViSpeak-Bench 79
- StreamingBench 84.4
- OmniMMI 53
- ZeroVideo 6.9
- BrowseComp 67.6
- BrowseComp-ZH 81.3
- GAIA 87.4
- WideSearch 63.8
- Humanity's Last Exam 21.4
- MM-BrowseComp 46.3
- HLE-VL 17.3
- SWE-bench Verified 72.9
- Multi-SWE-bench 42
- AInstein-SWE-Bench 36.7
- Terminal-Bench 2.0 45.2
- U-Artifacts 49.2
- BFCL V4 57.2
- tau2-bench 72
- DeepConsult 41
- DeepResearch Bench 43.5
- DiscoX 74.6
- FinSearchComp 62.8
- XpertBench
- WorldTravel
- OSWorld 61.9
- Online-Mind2Web 85.9
- AndroidWorld 70.7