IDEFICS-9B-Instruct
IDEFICS-9B-Instruct.
9
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Hugging Face Jul 2023 IDEFICS-9B-Instruct
Open weights Small
No Epoch Capabilities Index score yet
- MMBench-EN v1.1 35.2% #174 /178
- MMBench-CN v1.1 19.5% #174 /178
- MMBench 45.3% #149 /155
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MMBench-CN v1.1 | 19.5% | #174 of 178 | Official leaderboard |
Vision, audio and robotics
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| Image2Struct | 17.5 | #16 of 18 | Official leaderboard | |
| MMBench | 45.3% | #149 of 155 | Official leaderboard | |
| CCBench (MMBench Chinese Culture) | 7.80% | #147 of 152 | Official leaderboard | |
| MMBench-EN v1.1 | 35.2% | #174 of 178 | Official leaderboard | |
| MMStar | 21.6% | #173 of 173 | Official leaderboard | |
| MathVista | 19.8% | #43 of 43 | Official leaderboard | |
| VHELM | 4.51 | #41 of 41 | Official leaderboard |
Other
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| OpenVLM Leaderboard | 27.2 | #170 of 173 | Official leaderboard |