Benchmark Almanac

DeepSeek Coder 1.3B

DeepSeek Coder 1.3B.

DeepSeek Released 2 Nov 2023
4
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
DeepSeek Nov 2023

DeepSeek Coder 1.3B

Open weights

63.1 #270 of 271
Epoch Capabilities Index

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
MMLU 25.8% #125 of 127 Epoch AI
ARC-Challenge 25.4% #74 of 75 Epoch AI
WinoGrande 53.3% #75 of 76 Epoch AI

Math and science

BenchmarkScoreRankSource
GSM8K 4.40% #74 of 82 Epoch AI

DeepSeek's models over time

DeepSeek's models in color, against every other model on the Epoch Capabilities Index, by release date.

50 75 100 125 150 175 2023 2024 2025 2026 2027 DeepSeek V4.1 Flash 1017 DeepSeek-V4-Flash DeepSeek-V3.1 DeepSeek-V3 DeepSeek-V2 (MoE-236B, May 2024) DeepSeek Coder 1.3B DeepSeek Coder 33B 50 75 100 125 150 175 2023 2024 2025 2026 2027 DeepSeek V4.1 Flash 1017 DeepSeek-V4-Flash