Qwen3 Technical Report (arXiv 2505.09388) 14 May 2025
Capabilities
- MMLU-Redux 89.5
- GPQA Diamond 65.8
- C-Eval 86.6
- LiveBench 74.3
- IFEval 86.5
- Arena-Hard-Auto 91
- AlignBench 8.7
- Creative Writing v3 79.1
- WritingBench 7.7
- MATH-500 98
- AIME 2024 80.4
- AIME 2025 70.9
- ZebraLogic 89.5
- AutoLogi 88.7
- Berkeley Function Calling Leaderboard (BFCL) 69.1
- LiveCodeBench v5 62.6
- Codeforces rating 1974
- Multi-IF 72.2
- INCLUDE 71.9
- MMMLU 78.4
- MT-AIME2024 73.9
- PolyMath 46.1
- MLogiQA 70.1
- RULER 91.6