granite-4.0-1b model card (Hugging Face) 28 Oct 2025
- MMLU (5-shot) 59.4
- MMLU-Pro (5-shot, CoT) 34
- BBH (3-shot, CoT) 60.4
- AGI EVAL (0-shot, CoT) 49.2
- GPQA (0-shot, CoT; subset not stated) 29.9
- IFEval Average 77.4
- GSM8K (8-shot) 76.3
- GSM Symbolic (8-shot) 72.3
- Minerva Math (0-shot, CoT) 45.3
- DeepMind Math (0-shot, CoT) 34
- HumanEval (pass@1) 74
- HumanEval+ (pass@1) 69
- MBPP (pass@1) 65
- MBPP+ (pass@1) 57
- CRUXEval-O (pass@1) 33.1
- BigCodeBench (pass@1) 30.2
- BFCL v3 54.8
- MULTIPLE (pass@1) 32.2
- MMMLU (5-shot, 11 languages) 45
- INCLUDE (5-shot, 14 languages) 42.1
- MGSM (8-shot, 5 languages) 37.8
- SALAD-Bench 93.4
- AttaQ 85.3