CogVLM-17B-Chat
CogVLM-17B-Chat.
12
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Z.ai Nov 2023
CogVLM-17B-Chat
Open weights Small
No Epoch Capabilities Index score yet
- OCRBench v2 19.9% #62 /65
- A-Bench 66.9% #91 /116
- VCR (Visual Caption Restoration) 35.3% #11 /42
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MMBench-CN v1.1 | 54% | #158 of 178 | Official leaderboard |
Vision, audio and robotics
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| VCR (Visual Caption Restoration) | 35.3% | #11 of 42 | Official leaderboard | |
| A-Bench | 66.9% | #91 of 116 | Official leaderboard | |
| BLINK | 39.4% | #9 of 11 | Official leaderboard | |
| MMStar | 39.9% | #142 of 173 | Official leaderboard | |
| MMBench | 65.8% | #130 of 155 | Official leaderboard | |
| MMBench-EN v1.1 | 63.6% | #150 of 178 | Official leaderboard | |
| CCBench (MMBench Chinese Culture) | 19% | #138 of 152 | Official leaderboard | |
| MME | 1439.1 | #15 of 16 | Official leaderboard | |
| OCRBench v2 | 19.9% | #62 of 65 | Official leaderboard | |
| MMMU | 32.1% | #134 of 136 | Official leaderboard |
Other
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| OpenVLM Leaderboard | 47.9 | #134 of 173 | Official leaderboard |