Benchmark Almanac

Qwen3-VL-235B-A22B

Qwen3-VL-235B-A22B ranks first on 5 of the 84 benchmarks it has scores on.

Qwen Released 23 Sep 2025 Family Qwen3-VL The lab's model card
95
Benchmarks with a score
5
Ranked first, out of five or more models
12
In the top three
Qwen Sep 2025

Qwen3-VL-235B-A22B

Open weights Flagship

No Epoch Capabilities Index score yet
  • MMMU-Pro 69.3% #43 /72
  • SimpleVQA 61.3% #18 /23
  • ERQA 52.5% #20 /26

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
MMLU 90.6% #8 of 127 Model card
WritingBench 86.7 #2 of 14 Model card
Creative Writing v3 85.7 #2 of 12 Model card
MMBench-CN v1.1 88.6% #1 of 5 Model card
Multi-IF 79.1% #7 of 28 Model card
Arena-Hard v2.0 74.8% #6 of 24 Model card
MMLU-Redux 93.7% #10 of 38 Model card
MMLU-Pro 83.8% #40 of 151 Model card
SimpleQA 44.4% #16 of 59 Model card
HallusionBench 66.7% #7 of 23 Model card
IFEval 88.2% #45 of 126 Model card
LMArena (Elo) 1,395 #135 of 333 Official leaderboard
INCLUDE 80% #11 of 25 Model card
MMLU-ProX 80.6% #8 of 17 Model card
SuperGPQA 64.3% #15 of 26 Model card
SimpleVQA 61.3% #18 of 23 Model card
Humanity's Last Exam 13.6% #121 of 147 Model card
SIFo 77.3% #1 of 1 Model card

Math and science

BenchmarkScoreRankSource
ZebraLogic 97.3% #1 of 23 Model card
HiPhO 62.8% #8 of 35 Official leaderboard
AIME 2025 89.7% #51 of 143 Model card
GPQA Diamond 77.1% #128 of 284 Model card
PolyMath 57.8% #9 of 18 Model card
HMMT 2025 77.4% #37 of 49 Model card

Coding

BenchmarkScoreRankSource
Design2Code 93.4 #1 of 2 Model card
LiveCodeBench v6 70.1% #47 of 76 Model card
Codeforces rating 1,964 #28 of 41 Model card
OJBench 27.5% #10 of 12 Model card
ChartMimic 78.4 #1 of 1 Model card

Agents and tools

BenchmarkScoreRankSource
ScreenSpot 95.4% #1 of 11 Model card
Berkeley Function Calling Leaderboard (BFCL) 71.9% #17 of 47 Model card
OSWorld-G 68.3% #2 of 5 Model card
SnakeBench 25 #81 of 183 Official leaderboard
OSWorld 38.1% #6 of 12 Model card
ScreenSpot-Pro 61.8% #17 of 25 Model card
AndroidWorld 62% #14 of 18 Model card
Windows Agent Arena 32.1% #4 of 5 Model card
GameWorld 31.4% #10 of 12 Official leaderboard
MobileWorld 12.8% #16 of 18 Official leaderboard

Vision, audio and robotics

BenchmarkScoreRankSource
Math-VR 66.8% #1 of 26 Official leaderboard
DocVQA 96.5% #2 of 33 Model card
MMMU 78.7% #10 of 136 Official leaderboard
ChartQA 90.3% #4 of 37 Model card
MuirBench 80.1% #2 of 12 Model card
MM-MT-Bench 8.50 #1 of 6 Model card
MathVista 85.8% #11 of 64 Model card
InfographicVQA 89.5% #4 of 22 Model card
OCRBench v2 66.8% #5 of 20 Model card
MathVerse 85% #3 of 12 Model card
RefCOCO / RefCOCO+ / RefCOCOg 92.4% #5 of 19 Model card
MMStar 78.7% #9 of 30 Model card
BLINK 67.1% #9 of 28 Model card
VideoMME v2 (with subtitles) 28.1% #10 of 31 Official leaderboard
DynaMath 82.8% #6 of 17 Model card
OCRBench 87.5% #10 of 28 Model card
AI2D 89.2% #17 of 44 Model card
EmbSpatialBench 84.3% #4 of 10 Model card
MMBench-EN v1.1 90.6% #7 of 17 Model card
LogicVista 72.2% #5 of 12 Model card
ZeroBench 27.7% #11 of 25 Model card
We-Math 74.8% #5 of 11 Model card
RealWorldQA 81.3% #14 of 30 Model card
MATH-Vision (MathVision) 74.6% #20 of 42 Model card
CountBench 93.7% #10 of 20 Model card
RefSpatial-Bench 69.9% #4 of 8 Model card
MIA-Bench 92.7% #1 of 2 Model card
MVBench 75.2% #8 of 15 Model card
MLVU 83.8% #9 of 16 Model card
CharXiv (DQ) 90.5% #4 of 7 Model card
VisuLogic 34.4% #4 of 7 Model card
Video-MME 79% #25 of 42 Model card
MMMU-Pro 69.3% #43 of 72 Model card
MMVU 71.1% #12 of 20 Model card
MMLongBench-Doc 56.2% #8 of 13 Model card
Vision Arena 1,189 #85 of 136 Official leaderboard
MADQA 60.3% #10 of 16 Official leaderboard
V* 85.9% #8 of 12 Model card
Charades-STA 63.5% #2 of 3 Model card
VisualPuzzles 57.2% #2 of 3 Model card
Video-MMMU 80% #21 of 30 Model card
BabyVision 22.2% #19 of 27 Official leaderboard
CC-OCR 81.5% #6 of 8 Model card
VSI-Bench 60% #3 of 4 Model card
LVBench 63.6% #19 of 25 Model card
ERQA 52.5% #20 of 26 Model card
GeoBench 59% #37 of 48 Official leaderboard
ODinW-13 43.2% #7 of 9 Model card
CharXiv 66.1% #53 of 67 Model card
SUNRGBD 34.9 #4 of 5 Model card
VLMs Are Blind 79.5% #7 of 8 Model card
Hypersim 11.0 #3 of 3 Model card
ARKitScenes 53.7% #1 of 1 Model card
MathVision-Wildphoto 63.8% #1 of 1 Model card
RoboSpatial-Home 73.9% #1 of 1 Model card

Other

BenchmarkScoreRankSource
LiveBench 79.6% #2 of 27 Model card

Its launch post

The benchmarks the lab chose to headline, with the scores it gave.

Its system card

Every result in the longer documents the lab published with it. 25 of them aren't in the launch post.