Benchmark Almanac

Mistral AI

Best on the Capabilities Index Mistral Large 4 150.6
47 models 30 model cards read mistral.ai

Mistral AI's models against the field

Every model on the Epoch Capabilities Index by release date, with Mistral AI's in color.

50 75 100 125 150 175 2023 2024 2025 2026 2027 Mistral Large 4 Mistral Medium 3.5 Magistral Small 1.0 Mistral Small 3.1 Mistral Large 2 Mistral Large 50 75 100 125 150 175 2023 2024 2025 2026 2027 Mistral Large 4 Mistral Medium 3.5

Its strongest models

Mistral AI Oct 2026

Mistral Large 4

Flagship

150.6 #58 of 271
Epoch Capabilities Index
  • Harvey LAB (Legal Agent Benchmark) 15.8% #10 /80
  • CritPt 10.6% #57 /160
  • APEX-Agents 51.6% #28 /56
Mistral AI Apr 2026

Mistral Medium 3.5

Open weights Mid-size

141.5 #117 of 271
Epoch Capabilities Index
  • IFBench 69% #44 /70
  • Harvey LAB (Legal Agent Benchmark) 0.42% #61 /80
  • CritPt 0% #156 /160
Mistral AI May 2025

Mistral Medium 3

Closed weights Mid-size

134.0 #150 of 271
Epoch Capabilities Index
  • Humanity's Last Exam 4.52% #43 /47
  • GPQA Diamond 59.5% #128 /219
  • FrontierMath 0.35% #64 /70
Mistral AI Jun 2025

Magistral Small 1.0

Open weights

133.1 #153 of 271
Epoch Capabilities Index
  • MMMU-Pro 51.8% #64 /72
  • GPQA Diamond 56.1% #135 /219
  • LiveCodeBench v5 55.8% #33 /44
Mistral AI Nov 2024

Mistral Large 2

Nov 2024 snapshot Open weights

128.6 #170 of 271
Epoch Capabilities Index
  • SimpleQA Verified 22.3% #38 /56
  • GPQA Diamond 51.3% #143 /219
  • FrontierMath 0.34% #67 /70
Mistral AI Jul 2024

Mistral Large 2

Jul 2024 snapshot Open weights Flagship

127.6 #171 of 271
Epoch Capabilities Index
  • GPQA Diamond 49% #149 /219
  • KOR-Bench 53.1% #8 /33
  • SWT-bench 16.3% #5 /9

What its model cards measure

Tall ticks are Mistral AI model cards that list the benchmark in their headline table. Gray dots are cards that leave it out. Rows are the benchmarks the lab listed most, at least twice each, in the order it started using them.

HumanEval MMLU MBPP MATH GSM8K MT-Bench ARC-Challenge TriviaQA HellaSwag WinoGrande PIQA ARC-Easy Natural Questions Arena-Hard-Auto WildBench MultiPL-E LiveCodeBench GPQA Diamond MMLU-Pro SimpleQA MMMU ChartQA DocVQA AI2D SWE-bench Verified AIME 2025 AIME 2024 LiveCodeBench v5

Model cards

DateModelDocumentBenchmarks
29 Oct 2026 Mistral Large 4 (Le Chonk, open weights) Mistral Large 4 (Le Chonk) is now open weight (Mistral news) 7
6 Oct 2026 Mistral Large 4 Introducing Mistral Large 4 6
2 Jul 2026 Leanstral 1.5 Leanstral 1.5: Proof Abundance for All (Mistral news) 5
22 May 2026 Mistral Medium 3.5 Remote agents in Vibe, powered by Mistral Medium 3.5 7
16 Mar 2026 Leanstral Leanstral: Open-Source foundation for trustworthy vibe-coding (Mistral news) 1
16 Mar 2026 Mistral Small 4 Introducing Mistral Small 4 9
9 Dec 2025 Devstral Small 2 Introducing: Devstral 2 and Mistral Vibe CLI (Mistral news) 3
9 Dec 2025 Devstral 2 Introducing: Devstral 2 and Mistral Vibe CLI (Mistral news) 3
2 Dec 2025 Ministral 3 14B Ministral 3 14B Reasoning 2512 model card (Hugging Face) 4
2 Dec 2025 Mistral Large 3 Introducing Mistral 3 6
17 Sep 2025 Magistral Small 1.2 Magistral Small 1.2 (Magistral-Small-2509) model card (Hugging Face) 4
17 Sep 2025 Magistral Medium 1.2 Magistral Small 1.2 (Magistral-Small-2509) model card (Hugging Face) 4
24 Jul 2025 Magistral Small 1.1 Magistral-Small-2507 model card (Hugging Face) 4
24 Jul 2025 Magistral Medium 1.1 Magistral-Small-2507 model card (Hugging Face) 4
15 Jul 2025 Voxtral Small Voxtral (Mistral news) 3
10 Jul 2025 Devstral Small 1.1 Upgrading agentic coding capabilities with the new Devstral models (Mistral news) 1
10 Jul 2025 Devstral Medium Upgrading agentic coding capabilities with the new Devstral models (Mistral news) 1
20 Jun 2025 Mistral Small 3.2 Mistral-Small-3.2-24B-Instruct-2506 model card (Hugging Face) 17
10 Jun 2025 Magistral Small 1.0 Magistral-Small-2506 model card (Hugging Face) 4
10 Jun 2025 Magistral Medium 1.0 Magistral (launch post) 5
21 May 2025 Devstral Small 1.0 Devstral (Mistral news) 1
7 May 2025 Mistral Medium 3 Medium is the new large. (Mistral Medium 3 launch post) 13
17 Mar 2025 Mistral Small 3.1 Mistral Small 3.1 (Mistral news) 17
17 Feb 2025 Mistral Saba Mistral Saba (Mistral news) 2
30 Jan 2025 Mistral Small 3 Mistral Small 3 (launch post) + HF model cards Mistral-Small-24B-Instruct-2501 / Base-2501 14
13 Jan 2025 Codestral Codestral 25.01 (Mistral news) 8
24 Jul 2024 Mistral Large 2 Jul 2024 Large Enough (Mistral Large 2 launch post) + HF model card Mistral-Large-Instruct-2407 9
26 Feb 2024 Mistral Large Au Large (Mistral Large launch post) 10
11 Dec 2023 Mixtral 8x7B Mixtral of experts (launch post) 13
27 Sep 2023 Mistral 7B v0.1 Mistral 7B (launch post) 13

Every Mistral AI model