Benchmark Almanac

Qwen3-Omni-30B-A3B

Qwen3-Omni-30B-A3B.

Qwen Released 22 Sep 2025 Family Qwen3-Omni The lab's model card
38
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Qwen Sep 2025

Qwen3-Omni-30B-A3B

Open weights Mid-size

No Epoch Capabilities Index score yet
  • MMMU-Pro 57% #60 /72
  • OCRBench v2 61.3% #8 /65
  • HallusionBench 59.7% #20 /23

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
WritingBench 82.6 #4 of 14 Model card
Creative Writing v3 80.6 #6 of 12 Model card
Multi-IF 64% #20 of 28 Model card
MMLU-Redux 86.6% #28 of 38 Model card
Arena-Hard v2.0 55.1% #18 of 24 Model card
IFEval 81% #96 of 126 Model card
HallusionBench 59.7% #20 of 23 Model card

Math and science

BenchmarkScoreRankSource
GPQA Diamond 69.6% #174 of 284 Model card
ZebraLogic 76% #19 of 23 Model card
AIME 2025 65% #119 of 143 Model card
PolyMath 37.9% #17 of 18 Model card

Coding

BenchmarkScoreRankSource
MultiPL-E 81.4% #4 of 18 Model card

Agents and tools

BenchmarkScoreRankSource
Berkeley Function Calling Leaderboard (BFCL) 64.4% #35 of 47 Model card

Vision, audio and robotics

BenchmarkScoreRankSource
OCRBench v2 61.3% #8 of 65 Official leaderboard
MMAU 77.5% #4 of 14 Model card
MathVista 75.9% #29 of 64 Model card
ChartQA 86.8% #18 of 37 Model card
VideoMME v2 (with subtitles) 19.5% #19 of 31 Official leaderboard
Audio MC 24.3% #10 of 16 Official leaderboard
CountBench 90% #13 of 20 Model card
MMMU 69.1% #64 of 97 Model card
MM-MT-Bench 7.40 #4 of 6 Model card
VideoDR (with search) 37% #4 of 6 Official leaderboard
FLEURS 5.33% #2 of 3 Model card
VoiceBench 85.5% #7 of 10 Model card
AI2D 85.2% #32 of 44 Model card
MMSU 69% #4 of 5 Model card
MATH-Vision (MathVision) 56.3% #34 of 42 Model card
MLVU 75.2% #13 of 16 Model card
MMMU-Pro 57% #60 of 72 Model card
MMStar 68.5% #25 of 30 Model card
Daily-Omni 75.8% #5 of 6 Model card
Video-MME 70.5% #37 of 42 Model card
LVBench 50.2% #23 of 25 Model card
Video-Holmes 57.3% #6 of 6 Model card
WorldSense (omnimodal) 54% #5 of 5 Model card
MuChoMusic 52% #3 of 3 Model card

Other

BenchmarkScoreRankSource
LiveBench 71.8% #10 of 27 Model card

Its launch post

The benchmarks the lab chose to headline, with the scores it gave.

Its system card

Every result in the longer documents the lab published with it. 3 of them aren't in the launch post.