Qwen3-235B-A22B-Thinking-2507 model card 25 Jul 2025
- MMLU-Pro 84.4
- MMLU-Redux 93.8
- GPQA 81.1
- SuperGPQA 64.9
- AIME25 92.3
- HMMT25 83.9
- LiveBench 20241125 78.4
- HLE 18.2
- LiveCodeBench v6 (25.02-25.05) 74.1
- CFEval 2134
- OJBench 32.5
- IFEval 87.8
- Arena-Hard v2$ 79.7
- Creative Writing v3 86.1
- WritingBench 88.3
- BFCL-v3 71.9
- Mean of TAU1-Retail / TAU1-Airline 56.9
- Mean of TAU2-Retail / TAU2-Airline / TAU2-Telecom 58.5
- MultiIF 80.6
- MMLU-ProX 81
- INCLUDE 81
- PolyMATH 60.1