LongCat-Flash-Omni model card (Hugging Face) 31 Oct 2025
- OmniBench 61.4
- WorldSense 60.9
- DailyOmni 82.4
- UNO-Bench 49.9
- MMBench-EN test (MMBench-ZH test 88.7) 87.5
- RealWorldQA 74.8
- MMStar 70.9
- MathVista mini 77.9
- MMMU val 70.7
- MMVet 69
- BLINK 63.1
- MuirBench 77.1
- Mantis 84.8
- ChartQA 87.6
- DocVQA 91.8
- OCRBench 84.9
- OmniDocBench EN/ZH (lower is better) 22.8 / 29.0 22.8
- RefCOCO-avg 93.9
- CountBench 92.4
- VisualWebBench 78.7
- ScreenSpot-v2 91.2
- Best of AndroidControl low 91.2 / AndroidControl high 75.6 91.2
- MVBench 75.2
- NextQA 86.2
- TempCompass 82.2
- Best of VideoMME (w/o audio) 76.2 / VideoMME (w/ audio) 78.2 78.2
- LongVideoBench 69.3
- MMVU 67.1
- Video-MMMU 67.5
- Mean of LibriSpeech test-clean 1.57 / test-other 4.01 2.79
- AISHELL-1 0.63
- AISHELL-2 2.78
- Fleurs (zh | en) 3.99 | 5.02 3.99
- CommonVoice 15 (zh | en) 4.98 | 13.59 4.98
- Mean of WenetSpeech test-meeting 6.69 / test-net 6.09 6.39
- Mean of CoVost2 en→zh 47.23 / CoVost2 zh→en 27.32 37.3
- MMAU 75.9
- ClothoAQA 72.8
- Mean of OpenAudioBench LlamaQuestions 83.33 / ReasoningQA 79.71 / TriviaQA 86.20 / Webquestions 76.00 / AlpacaEval 75.43 80.1
- Mean of VoiceBench AlpacaEval 4.94 / CommonEval 4.32 (GPT scores x20) / OpenBookQA 93.41 / SDQA 82.46 / MMSU 81.95 / AdvBench 100 / IFEval 77.99, computed by the almanac 88.7
- MMLU(acc) 90.3
- MMLU-Pro(acc) 82.7
- CEval(acc) 91.7
- CMMLU(acc) 89.4
- IFEval(acc), text 82.4
- COLLIE(acc) 45.7
- Meeseeks-zh(acc) 39
- MATH500(acc) 97.6
- AIME24(avg@10) 72.9
- BeyondAIME(avg@10) 47.4
- GPQA-diamond(acc) 74.4
- DROP(f1) 83.5
- ZebraLogic(acc) 86
- GraphWalks-128k(precision) 56
- LiveCodeBench(pass@1) 52.6
- Humaneval+(pass@1) 90.8
- MBPP+(pass@1) 80.2