General365
Models solve 365 hand-written reasoning problems and 1,095 variants in eight categories that need only K-12 knowledge. Scoring mixes rule-based and model-based checks.
Half of the questions are public and half are held out to track contamination.
In the authors’ words
Contemporary large language models (LLMs) have demonstrated remarkable reasoning capabilities, particularly in specialized domains like mathematics and physics. However, their ability to generalize these reasoning skills to more general and broader contexts–often termed general reasoning–remains under-explored. Unlike domain-specific reasoning, general reasoning relies less on expert knowledge but still presents formidable reasoning challenges, such as complex constraints, nested logical branches, and semantic interference. To address this gap, we introduce General365, a benchmark specifically designed to assess general reasoning in LLMs. By restricting background knowledge to a K-12 level, General365 explicitly decouples reasoning from specialized expertise. The benchmark comprises 365 seed problems and 1,095 variant problems across eight categories, ensuring both high difficulty and diversity. Evaluations across 26 leading LLMs reveal that even the top-performing model achieves only 62.8% accuracy, in stark contrast to the near-perfect performances of LLMs in math and physics benchmarks. These results suggest that the reasoning abilities of current LLMs are heavily domain-dependent, leaving significant room for improvement in broader applications. We envision General365 as a catalyst for advancing LLM reasoning beyond domain-specific tasks toward robust, general-purpose real-world scenarios. Code, Dataset, and Leaderboard: https://general365.github.io
- Level
- Everyday Most adults, without training
- Scored
- Checked automatically A program checks the result against an answer key, unit tests or the expected final state.
- Answers
- Short answer A number, word or short string matched to a key.
Gemini 3 Pro leads with 62.8% among models released by Feb 2026
Best score per entry from the benchmark's own leaderboard, read on 2 Nov 2026. Where a model ran with several settings or harnesses, we keep its best. Names in gray aren't in our model list: fine-tunes, agent systems, products and older models. They don't count toward leaders.
The newest model with a score here came out in Feb 2026, and nobody has tested a newer one. Among the 20 highest-ranked models on the capability index, these have no score yet:
- GPT-6 Astra
- Claude Opus 5.5
- GPT-6.1 Terra
- GPT-6.1 Sol
- and 16 more
- 62.8
Gemini 3 Pro
- 60.8
Gemini 3 Flash
- 59.9 GLM-5
- 58.6 GPT-5
- 58.2 GPT-5.1
- 57.7
Qwen3.5 397B-A17B
- 57.5
DeepSeek-V3.2-Speciale
- 57.4 GLM-4.7
- 57.2
Qwen3-Max
- 56.4 Kimi K2.5
- 54.9
DeepSeek-V3.2
- 53.1 Grok 4.1 Fast
- 53.0 Kimi K2 Thinking
- 52.9 GLM-4.6
- 51.0 o4-mini
- 50.8
LongCat-Flash-Thinking-2601
- 48.7
Gemini 2.5 Pro
- 48.6 Claude Sonnet 4.5
- 48.1
DeepSeek-V3.1
- 47.9
Qwen3-235B-A22B-Thinking
- 44.4 o3-mini
- 44.4
LongCat-Flash-Thinking
- 41.7 LongCat-Flash-2512
- 39.6
Gemini 2.5 Flash
- 1
Gemini 3 Pro thinking 62.8%
- 2
Gemini 3 Flash thinking 60.8%
- 3 GLM-5 thinking 59.9%
- 4 GPT-5 thinking 58.6%
- 5 GPT-5.1 thinking 58.2%
- 6
Qwen3.5 397B-A17B thinking 57.7%
- 7
DeepSeek-V3.2-Speciale thinking 57.5%
- 8 GLM-4.7 thinking 57.4%
- 9
Qwen3-Max thinking 57.2%
- 10 Kimi K2.5 thinking 56.4%
- 11
DeepSeek-V3.2 thinking 54.9%
- 12 Grok 4.1 Fast thinking 53.1%
- 13 Kimi K2 Thinking thinking 53%
- 14 GLM-4.6 thinking 52.9%
- 15 o4-mini thinking 51%
- 16
LongCat-Flash-Thinking-2601 thinking 50.8%
- 17
Gemini 2.5 Pro Jun 2025, thinking 48.7%
- 18 Claude Sonnet 4.5 thinking 48.6%
- 19
DeepSeek-V3.1 thinking 48.1%
- 20
Qwen3-235B-A22B-Thinking Jul 2025, thinking 47.9%
- 21 o3-mini thinking 44.4%
- 22
LongCat-Flash-Thinking thinking 44.4%
- 23 LongCat-Flash-2512 non-thinking 41.7%
- 24
Gemini 2.5 Flash Sep 2025, thinking 39.6%
| # | Entry | Score | Setting | Date | Source |
|---|---|---|---|---|---|
| 1 | | 62.8% | thinking | Nov 2025 | Official leaderboard |
| 2 | | 60.8% | thinking | Dec 2025 | Official leaderboard |
| 3 | GLM-5 | 59.9% | thinking | Feb 2026 | Official leaderboard |
| 4 | GPT-5 | 58.6% | thinking | Aug 2025 | Official leaderboard |
| 5 | GPT-5.1 | 58.2% | thinking | Nov 2025 | Official leaderboard |
| 6 | | 57.7% | thinking | Feb 2026 | Official leaderboard |
| 7 | | 57.5% | thinking | Dec 2025 | Official leaderboard |
| 8 | GLM-4.7 | 57.4% | thinking | Dec 2025 | Official leaderboard |
| 9 | | 57.2% | thinking | Sep 2025 | Official leaderboard |
| 10 | Kimi K2.5 | 56.4% | thinking | Jan 2026 | Official leaderboard |
| 11 | | 54.9% | thinking | Dec 2025 | Official leaderboard |
| 12 | Grok 4.1 Fast | 53.1% | thinking | Nov 2025 | Official leaderboard |
| 13 | Kimi K2 Thinking | 53% | thinking | Nov 2025 | Official leaderboard |
| 14 | GLM-4.6 | 52.9% | thinking | Sep 2025 | Official leaderboard |
| 15 | o4-mini | 51% | thinking | Apr 2025 | Official leaderboard |
| 16 | | 50.8% | thinking | Jan 2026 | Official leaderboard |
| 17 | | 48.7% | thinking | Jun 2025 | Official leaderboard |
| 18 | Claude Sonnet 4.5 | 48.6% | thinking | Sep 2025 | Official leaderboard |
| 19 | | 48.1% | thinking | Aug 2025 | Official leaderboard |
| 20 | | 47.9% | thinking | Jul 2025 | Official leaderboard |
| 21 | o3-mini | 44.4% | thinking | Jan 2025 | Official leaderboard |
| 22 | | 44.4% | thinking | Sep 2025 | Official leaderboard |
| 23 | LongCat-Flash-2512 | 41.7% | non-thinking | Official leaderboard | |
| 24 | | 39.6% | thinking | Sep 2025 | Official leaderboard |
Number one over time
Lab claims count from the day the card came out, independent runs from the model’s release.
Scores over time
All the scores we have, one dot each, so a model tested at several settings appears more than once.
No lab model card reports it yet
We read the headline results of 479 launch posts from 51 labs, and none of them list this benchmark.
More in Science and reasoning
- GPQA Diamond In use 198 graduate-level 'Google-proof' multiple-choice questions in biology, chemistry and physics.
Gemini 4 Argon 96.4%
- Terminal-Bench-Science In use 70 scientific research-workflow tasks across five science areas, run in Harbor containers. Hidden tests give the resolution rate. GPT-6 Astra 68.1%
- FrontierScience In use Models solve physics, chemistry, and biology problems in an Olympiad track graded by short answer and a Research track graded by 10-point rubrics.
Intern-S2-397B 87%
- BioMysteryBench In use Bioinformatics problems on anonymized real datasets that require real analysis with tools. Rubric-graded, with human-solvable and human-difficult splits. Claude Opus 5 90.1%
- HiPhO In use Models solve theory problems from 2024 and 2025 physics olympiad exams, some with diagrams. Official marking schemes grade answers and steps, mapped to medal levels.
Gemini 3 Pro 78.3%
- LABBench2 In use 11 biology research sub-tasks (literature, figures, tables, patents, trials and more) with tool access. Macro-averaged accuracy. GPT-5.2 60.9%