LongCat-Flash-Thinking model card (Hugging Face) 21 Sep 2025
- MMLU-Pro(acc) 82.6
- MMLU-Redux(acc) 89.3
- IFEval(strict prompt) 86.9
- Arena-Hard(hard prompt gemini) 69.9
- MATH500(Mean@1) 99.2
- HMMT25(Mean@32) 83.7
- AIME24(Mean@32) 93.3
- AIME25(Mean@32) 90.6
- BeyondAIME(Mean@10) 69.5
- GPQA-Diamond(Mean@16) 81.5
- ZebraLogic(Mean@1) 95.5
- Sudoku-Bench(Mean@1) 56
- ARC-AGI(Mean@1) 50.3
- LiveCodeBench(Mean@4) 79.4
- OJBench(Mean@1) 40.7
- SWE-Bench(Pass@1) 59.4
- BFCL V3(full) 74.4
- Mean of τ²-Bench-Retail 71.5 / τ²-Bench-Airline 67.5 / τ²-Bench-Telecom 83.1 (Mean@4) 74
- VitaBench 29.5
- Best of MiniF2F-Test Pass@1 67.6 / Pass@8 79.4 / Pass@32 81.6 81.6
- Mean of Safety Harmful 93.7 / Criminal 97.1 / Misinformation 93.0 / Privacy 98.8 95.7