granite-4.1-30b model card (Hugging Face) 29 Apr 2026
- MMLU (5-shot) 80.2
- MMLU-Pro (5-shot, CoT) 64.1
- BBH (3-shot, CoT) 83.7
- AGI EVAL (0-shot, CoT) 77.8
- GPQA (0-shot, CoT; subset not stated) 45.8
- SimpleQA 6.81
- AlpacaEval 2.0 56.2
- IFEval Avg 89.7
- ArenaHard 71
- MTBench Avg 8.61
- GSM8K (8-shot) 94.2
- GSM Symbolic (8-shot) 75.7
- Minerva Math (0-shot, CoT) 81.3
- DeepMind Math (0-shot, CoT) 81.9
- HumanEval (pass@1) 88.4
- HumanEval+ (pass@1) 85.4
- MBPP (pass@1) 85.5
- MBPP+ (pass@1) 73.5
- CRUXEval-O (pass@1) 55.8
- BigCodeBench (pass@1) 38.8
- MULTIPLE (pass@1) 62.3
- BFCL v3 73.7
- MMMLU (5-shot, 11 languages) 73.7
- INCLUDE (5-shot, 14 languages) 67.3
- MGSM (8-shot, 5 languages) 71.1
- SALAD-Bench 96.4
- AttaQ 85.8
- Tulu3 Safety Eval Avg 78.2