- MMBench-EN-v1.1 (Acc) 84.4
- RealWorldQA (Acc) 70
- OCRBench (Acc) 869 86.9
- MMStar (Acc) 70.4
- MMVet (Acc) 78.1
- MMMU (val, Pass@1) 64
- MMMU-Pro (Pass@1) 46.3
- MATH-Vision (Pass@1) 56.9
- MathVista_MINI (Pass@1) 80.1
- VideoMMMU (Pass@1) 65.2
- MMVU (Pass@1) 57.5
- Video-MME (w/ sub.) 71.9
- ScreenSpot-Pro (Acc) 52.8
- ScreenSpot-V2 (Acc) 91.4
- OSWorld-G (Acc, full set with refusal) 52.5
- MMLongBench-DOC (Acc) 42.1
- MMLU 82
- MMLU-Pro 68.5
- MATH 91.8
- GPQA-Diamond 42.3
- V* Benchmark (without extra tools) 83.2
Kimi-VL-A3B-Thinking-2506
Kimi-VL-A3B-Thinking-2506 places in the top three on MM-Vet.
23
Benchmarks with a score
0
Ranked first, out of five or more models
1
In the top three
Moonshot AI Jun 2025
Kimi-VL-A3B-Thinking-2506
Open weights Small
No Epoch Capabilities Index score yet
- MMMU-Pro 46.3% #67 /72
- MMVU 57.5% #20 /20
- MMLongBench-Doc 42.1% #12 /13
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MMBench-CN v1.1 | 79.8% | #46 of 178 | Official leaderboard | |
| MMLU | 82% | #63 of 127 | Model card | |
| MMLU-Pro | 68.5% | #117 of 151 | Model card |
Math and science
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MATH | 91.8% | #7 of 93 | Model card | |
| GPQA Diamond | 42.3% | #250 of 284 | Model card |
Agents and tools
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| ScreenSpot-v2 | 91.4% | #9 of 14 | Model card | |
| ScreenSpot-Pro | 52.8% | #21 of 25 | Model card | |
| OSWorld-G | 52.5% | #5 of 5 | Model card |
Vision, audio and robotics
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MM-Vet | 78.1% | #2 of 8 | Model card | |
| MMBench-EN v1.1 | 80.4% | #50 of 178 | Official leaderboard | |
| OCRBench | 86.9% | #11 of 28 | Model card | |
| MathVista | 80.1% | #26 of 64 | Model card | |
| MMMU | 64% | #75 of 97 | Model card | |
| MATH-Vision (MathVision) | 56.9% | #33 of 42 | Model card | |
| MMStar | 70.4% | #24 of 30 | Model card | |
| RealWorldQA | 70% | #25 of 30 | Model card | |
| V* | 83.2% | #10 of 12 | Model card | |
| Video-MME | 71.9% | #36 of 42 | Model card | |
| MMLongBench-Doc | 42.1% | #12 of 13 | Model card | |
| MMMU-Pro | 46.3% | #67 of 72 | Model card | |
| Video-MMMU | 65.2% | #28 of 30 | Model card | |
| MMVU | 57.5% | #20 of 20 | Model card |
Other
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| OpenVLM Leaderboard | 74.3 | #15 of 173 | Official leaderboard |
Its launch post
The benchmarks the lab chose to headline, with the scores it gave.
Its system card
Every result in the longer documents the lab published with it.
Kimi-VL Technical Report 23 Jun 2025
Capabilities
- MATH-Vision (MathVision) 56.9
- MathVista 80.1
- MMMU 64
- MMMU-Pro 46.3
- Video-MMMU 65.2
- MMBench-EN v1.1 84.4
- RealWorldQA 70
- OCRBench 86.9
- MMStar 70.4
- MM-Vet 78.1
- MMVU 57.5
- Video-MME 71.9
- ScreenSpot-Pro 52.8
- ScreenSpot-v2 91.4
- OSWorld-G 52.5
- MMLongBench-Doc 42.1
- V* 83.2