Benchmark Almanac

Yi 6B

Yi 6B.

01.AI Released 2 Nov 2023
8
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
01.AI Nov 2023

Yi 6B

Open weights

104.7 #240 of 271
Epoch Capabilities Index

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
BIG-Bench Hard 47.2% #26 of 45 Epoch AI
WinoGrande 71.3% #44 of 76 Epoch AI
MMLU 64% #75 of 127 Epoch AI
HellaSwag 74.4% #45 of 74 Epoch AI
ARC-Challenge 50.3% #47 of 75 Epoch AI
MMLU-Pro 26.5% #186 of 212 Official leaderboard

Math and science

BenchmarkScoreRankSource
GSM8K 44.9% #42 of 82 Epoch AI

Other

BenchmarkScoreRankSource
HELM Lite 25.4 #65 of 71 Official leaderboard

01.AI's models over time

01.AI's models in color, against every other model on the Epoch Capabilities Index, by release date.

50 75 100 125 150 175 2023 2024 2025 2026 2027 Yi-34B Yi 6B 50 75 100 125 150 175 2023 2024 2025 2026 2027 Yi-34B Yi 6B