- MMBench DEV_EN_V11 (VLMEvalKit) 68.7
- MMStar 51.8
- RealWorldQA 62.2
- GQA TestDev_Balanced 57.4
- MMMB 72.8
- BLINK 52.7
- ChartQA Test 80.8
- DocVQA VAL 92.1
- InfoVQA VAL 65.2
- OCRBench v2_en 36.7
- OCRBench (0.792) 79.2
- AI2D_TEST 77.5
- MMMU DEV_VAL 32.9
- RefCOCO avg (average of 8 RefCOCO, RefCOCO+ and RefCOCOg splits) 73.2
- CountBench 72.5
- HallusionBench 61.5
- MMLU test 50.4
- MMLU-Pro test 30.7
- Multi-If 37.3
- IFEval 74.9
North Micro Vision Instruct
North Micro Vision Instruct.
20
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
North Micro Vision Instruct
Open weights Small
No Epoch Capabilities Index score yet
- HallusionBench 61.5% #17 /23
- BLINK 52.7% #24 /28
- MMLU-Pro 30.7% #149 /151
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
Vision, audio and robotics
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| DocVQA | 92.1% | #22 of 33 | Model card | |
| CountBench | 72.5% | #17 of 20 | Model card | |
| BLINK | 52.7% | #24 of 28 | Model card | |
| InfographicVQA | 65.2% | #19 of 22 | Model card | |
| ChartQA | 80.8% | #33 of 37 | Model card | |
| RealWorldQA | 62.2% | #27 of 30 | Model card | |
| OCRBench | 79.2% | #26 of 28 | Model card | |
| MMStar | 51.8% | #29 of 30 | Model card | |
| AI2D | 77.5% | #43 of 44 | Model card | |
| MMMU | 32.9% | #97 of 97 | Model card | |
| OCRBench v2 | 36.7% | #20 of 20 | Model card | |
| RefCOCO / RefCOCO+ / RefCOCOg | 73.2% | #19 of 19 | Model card | |
| MMBench-EN v1.1 | 68.7% | #17 of 17 | Model card | |
| GQA | 57.4% | #2 of 2 | Model card |
Its launch post
The benchmarks the lab chose to headline, with the scores it gave.