Benchmark Almanac

General365

Gemini 3 Pro 62.8% leads since Apr 2026 Not in model cards

Models solve 365 hand-written reasoning problems and 1,095 variants in eight categories that need only K-12 knowledge. Scoring mixes rule-based and model-based checks.

Half of the questions are public and half are held out to track contamination.

In the authors’ words

Contemporary large language models (LLMs) have demonstrated remarkable reasoning capabilities, particularly in specialized domains like mathematics and physics. However, their ability to generalize these reasoning skills to more general and broader contexts–often termed general reasoning–remains under-explored. Unlike domain-specific reasoning, general reasoning relies less on expert knowledge but still presents formidable reasoning challenges, such as complex constraints, nested logical branches, and semantic interference. To address this gap, we introduce General365, a benchmark specifically designed to assess general reasoning in LLMs. By restricting background knowledge to a K-12 level, General365 explicitly decouples reasoning from specialized expertise. The benchmark comprises 365 seed problems and 1,095 variant problems across eight categories, ensuring both high difficulty and diversity. Evaluations across 26 leading LLMs reveal that even the top-performing model achieves only 62.8% accuracy, in stark contrast to the near-perfect performances of LLMs in math and physics benchmarks. These results suggest that the reasoning abilities of current LLMs are heavily domain-dependent, leaving significant room for improvement in broader applications. We envision General365 as a catalyst for advancing LLM reasoning beyond domain-specific tasks toward robust, general-purpose real-world scenarios. Code, Dataset, and Leaderboard: https://general365.github.io

Abstract of General365: Benchmarking General Reasoning in Large Language Models Across Diverse and Challenging Tasks (arXiv:2604.11778, CC0)
Made by Meituan LongCat Team Released Apr 2026 Abstract puzzles and logic Public tasks plus a private test set Last model added Feb 2026 Scores refreshed 2 Nov 2026
Level
Everyday Most adults, without training
Scored
Checked automatically A program checks the result against an answer key, unit tests or the expected final state.
Answers
Short answer A number, word or short string matched to a key.
24
Entries on its own leaderboard, 23 models we track

Gemini 3 Pro leads with 62.8% among models released by Feb 2026

Best score per entry from the benchmark's own leaderboard, read on 2 Nov 2026. Where a model ran with several settings or harnesses, we keep its best. Names in gray aren't in our model list: fine-tunes, agent systems, products and older models. They don't count toward leaders.

The newest model with a score here came out in Feb 2026, and nobody has tested a newer one. Among the 20 highest-ranked models on the capability index, these have no score yet:

  1. 1 Gemini 3 Pro thinking 62.8%
  2. 2 Gemini 3 Flash thinking 60.8%
  3. 3 GLM-5 thinking 59.9%
  4. 4 GPT-5 thinking 58.6%
  5. 5 GPT-5.1 thinking 58.2%
  6. 6 Qwen3.5 397B-A17B thinking 57.7%
  7. 7 DeepSeek-V3.2-Speciale thinking 57.5%
  8. 8 GLM-4.7 thinking 57.4%
  9. 9 Qwen3-Max thinking 57.2%
  10. 10 Kimi K2.5 thinking 56.4%
  11. 11 DeepSeek-V3.2 thinking 54.9%
  12. 12 Grok 4.1 Fast thinking 53.1%
  13. 13 Kimi K2 Thinking thinking 53%
  14. 14 GLM-4.6 thinking 52.9%
  15. 15 o4-mini thinking 51%
  16. 16 LongCat-Flash-Thinking-2601 thinking 50.8%
  17. 17 Gemini 2.5 Pro Jun 2025, thinking 48.7%
  18. 18 Claude Sonnet 4.5 thinking 48.6%
  19. 19 DeepSeek-V3.1 thinking 48.1%
  20. 20 Qwen3-235B-A22B-Thinking Jul 2025, thinking 47.9%
  21. 21 o3-mini thinking 44.4%
  22. 22 LongCat-Flash-Thinking thinking 44.4%
  23. 23 LongCat-Flash-2512 non-thinking 41.7%
  24. 24 Gemini 2.5 Flash Sep 2025, thinking 39.6%
#EntryScoreSettingDateSource
1 Gemini 3 Pro 62.8% thinking Nov 2025 Official leaderboard
2 Gemini 3 Flash 60.8% thinking Dec 2025 Official leaderboard
3 GLM-5 59.9% thinking Feb 2026 Official leaderboard
4 GPT-5 58.6% thinking Aug 2025 Official leaderboard
5 GPT-5.1 58.2% thinking Nov 2025 Official leaderboard
6 Qwen3.5 397B-A17B 57.7% thinking Feb 2026 Official leaderboard
7 DeepSeek-V3.2-Speciale 57.5% thinking Dec 2025 Official leaderboard
8 GLM-4.7 57.4% thinking Dec 2025 Official leaderboard
9 Qwen3-Max 57.2% thinking Sep 2025 Official leaderboard
10 Kimi K2.5 56.4% thinking Jan 2026 Official leaderboard
11 DeepSeek-V3.2 54.9% thinking Dec 2025 Official leaderboard
12 Grok 4.1 Fast 53.1% thinking Nov 2025 Official leaderboard
13 Kimi K2 Thinking 53% thinking Nov 2025 Official leaderboard
14 GLM-4.6 52.9% thinking Sep 2025 Official leaderboard
15 o4-mini 51% thinking Apr 2025 Official leaderboard
16 LongCat-Flash-Thinking-2601 50.8% thinking Jan 2026 Official leaderboard
17 Gemini 2.5 Pro Jun 2025 48.7% thinking Jun 2025 Official leaderboard
18 Claude Sonnet 4.5 48.6% thinking Sep 2025 Official leaderboard
19 DeepSeek-V3.1 48.1% thinking Aug 2025 Official leaderboard
20 Qwen3-235B-A22B-Thinking Jul 2025 47.9% thinking Jul 2025 Official leaderboard
21 o3-mini 44.4% thinking Jan 2025 Official leaderboard
22 LongCat-Flash-Thinking 44.4% thinking Sep 2025 Official leaderboard
23 LongCat-Flash-2512 41.7% non-thinking Official leaderboard
24 Gemini 2.5 Flash Sep 2025 39.6% thinking Sep 2025 Official leaderboard

Number one over time

Lab claims count from the day the card came out, independent runs from the model’s release.

Google DeepMind
Own leaderboard Not tested since Apr 2026
Gemini 3 Pro 62.8%

Scores over time

All the scores we have, one dot each, so a model tested at several settings appears more than once.

On the benchmark’s own leaderboard Best so far
0% 20% 40% 60% 80% 100% 2025 2026 Near the ceiling (85%) Gemini 3 Pro GPT-5 o4-mini o3-mini 0% 20% 40% 60% 80% 100% 2025 2026 Near the ceiling (85%) Gemini 3 Pro o4-mini

No lab model card reports it yet

We read the headline results of 479 launch posts from 51 labs, and none of them list this benchmark.

More in Science and reasoning

All 88 in Science and reasoning
  • GPQA Diamond In use 198 graduate-level 'Google-proof' multiple-choice questions in biology, chemistry and physics. Gemini 4 Argon 96.4%
  • Terminal-Bench-Science In use 70 scientific research-workflow tasks across five science areas, run in Harbor containers. Hidden tests give the resolution rate. GPT-6 Astra 68.1%
  • FrontierScience In use Models solve physics, chemistry, and biology problems in an Olympiad track graded by short answer and a Research track graded by 10-point rubrics. Intern-S2-397B 87%
  • BioMysteryBench In use Bioinformatics problems on anonymized real datasets that require real analysis with tools. Rubric-graded, with human-solvable and human-difficult splits. Claude Opus 5 90.1%
  • HiPhO In use Models solve theory problems from 2024 and 2025 physics olympiad exams, some with diagrams. Official marking schemes grade answers and steps, mapped to medal levels. Gemini 3 Pro 78.3%
  • LABBench2 In use 11 biology research sub-tasks (literature, figures, tables, patents, trials and more) with tool access. Macro-averaged accuracy. GPT-5.2 60.9%