Qwen3 Technical Report (arXiv 2505.09388) 14 May 2025
Capabilities
- MMLU-Redux 88.6
- GPQA Diamond 64
- C-Eval 86.2
- LiveBench 71.3
- IFEval 85.4
- Arena-Hard-Auto 91.7
- AlignBench 8.56
- Creative Writing v3 80.3
- WritingBench 7.8
- MATH-500 96.8
- AIME 2024 79.3
- AIME 2025 70.4
- ZebraLogic 88.5
- AutoLogi 89.2
- Berkeley Function Calling Leaderboard (BFCL) 70.4
- LiveCodeBench v5 63.5
- Codeforces rating 1766
- Multi-IF 74.8
- INCLUDE 71.7
- MMMLU 77.9
- MT-AIME2024 73.3
- PolyMath 45.8
- MLogiQA 71.1
- RULER 94.6
- Belebele