Yi-1.5-6B-Chat
Yi-1.5-6B-Chat.
10
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
01.AI May 2024 Yi-1.5-6B-Chat
Open weights Small
No Epoch Capabilities Index score yet
- KOR-Bench 32.5% #27 /33
- Vectara Hallucination Leaderboard (HHEM) 7.90% #31 /148
- BigCodeBench-Hard 5.40% #91 /96
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| Vectara Hallucination Leaderboard (HHEM) | 7.90% | #31 of 148 | Official leaderboard | |
| MMLU-CF | 52.8% | #28 of 37 | Official leaderboard | |
| MMLU-Pro | 38.2% | #166 of 212 | Official leaderboard | |
| EQ-Bench v2 | 59.5 | #67 of 85 | Official leaderboard | |
| SuperGPQA | 19.2% | #53 of 58 | Official leaderboard | |
| WildBench | 25.3 | #44 of 47 | Official leaderboard |
Math and science
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| KOR-Bench | 32.5% | #27 of 33 | Official leaderboard |
Coding
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| BigCodeBench | 29.8% | #62 of 69 | Official leaderboard | |
| BigCodeBench-Hard | 5.40% | #91 of 96 | Official leaderboard |
Agents and tools
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| SuperCLUE-Agent | 62.2 | #5 of 7 | Official leaderboard |