Qwen3 Technical Report (arXiv 2505.09388) 14 May 2025
Capabilities
- MMLU-Redux 90.9
- GPQA Diamond 68.4
- C-Eval 87.3
- LiveBench 74.9
- IFEval 85
- Arena-Hard-Auto 93.8
- AlignBench 8.72
- Creative Writing v3 81
- WritingBench 7.9
- MATH-500 97.2
- AIME 2024 81.4
- AIME 2025 72.9
- ZebraLogic 88.8
- AutoLogi 87.3
- Berkeley Function Calling Leaderboard (BFCL) 70.3
- LiveCodeBench v5 65.7
- Codeforces rating 1977
- Multi-IF 73
- INCLUDE 73.7
- MMMLU 80.6
- MT-AIME2024 75
- PolyMath 47.4
- MLogiQA 76.3
- RULER 93.7
- Belebele
- LengthCtrl (Qwen) 73.5
- ThinkFollow (Qwen) 98.9
- ToolUse (Qwen) 85.5
Hallucination
- CounterFactQA (Qwen) 68.1