Benchmark Almanac

DeepSeekMath-7B-Instruct

DeepSeekMath-7B-Instruct.

DeepSeek Released February 5th, 2024 Family DeepSeekMath The lab's model card Compare with others
3
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
DeepSeek Feb 2024

DeepSeekMath-7B-Instruct

Open weights Small

No Epoch Capabilities Index score yet
  • MathBench 40.9% #13 /21

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
MMLU-Pro 35.3% #171 of 212 Official leaderboard

Math and science

BenchmarkScoreRankSource
MathBench 40.9% #13 of 21 Official leaderboard
TheoremQA 23.7% #3 of 4 Official leaderboard