Kimi K2 Instruct model card (Hugging Face) 11 Jul 2025
- LiveCodeBench v6 (Aug 24 - May 25), Pass@1 53.7
- OJBench, Pass@1 27.1
- MultiPL-E, Pass@1 85.7
- SWE-bench Verified (Agentic Coding), Single Attempt (Acc) 65.8
- SWE-bench Multilingual (Agentic Coding), Single Attempt (Acc) 47.3
- TerminalBench, Inhouse Framework (Acc) 30
- Aider-Polyglot, Acc 60
- Mean of Tau2 retail, Avg@4 / Tau2 airline, Avg@4 / Tau2 telecom, Avg@4 64.3
- AceBench, Acc 76.5
- AIME 2024, Avg@64 69.6
- AIME 2025, Avg@64 49.5
- MATH-500, Acc 97.4
- HMMT 2025, Avg@32 38.8
- CNMO 2024, Avg@16 74.3
- PolyMath-en, Avg@4 65.1
- ZebraLogic, Acc 89
- AutoLogi, Acc 89.5
- GPQA-Diamond, Avg@8 75.1
- SuperGPQA, Acc 57.2
- Humanity's Last Exam (Text Only) 4.7
- MMLU, EM 89.5
- MMLU-Redux, EM 92.7
- MMLU-Pro, EM 81.1
- IFEval, Prompt Strict 89.8
- Multi-Challenge, Acc 54.1
- SimpleQA, Correct 31
- Livebench, Pass@1 76.4