Benchmark Almanac

Mathstral-7B-v0.1

Mathstral-7B-v0.1.

Mistral AI Released 16 Jul 2024 Family Mathstral The lab's model card
4
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Mistral AI Jul 2024

Mathstral-7B-v0.1

Open weights Small

No Epoch Capabilities Index score yet
  • OlympicArena 20.1% #14 /25
  • Omni-MATH 19.1% #9 /9

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
MMLU-Pro 42% #156 of 212 Official leaderboard

Math and science

BenchmarkScoreRankSource
OlympicArena 20.1% #14 of 25 Official leaderboard
ZebraLogic 9.00% #39 of 46 Official leaderboard
Omni-MATH 19.1% #9 of 9 Official leaderboard