Decision Index
KnowLine 31B Gen1 71.9 tops its leaderboard 
Gemma 4 31B IT 67.6 leads the models we track Not in model cards
Gemma 4 31B IT 67.6 leads the models we track Not in model cards Decision models read a state and a typed question and return a decision. The index weights private same-skill sets and new-domain sets, equated on 21 base models.
Tracks reproductions of TypeSafe's Jev decision model. Version 0.4.1 board lists 248 entries. A separate vision board exists.
Made by Hugging Face community (apolinario, multimodalart) Released Sep 2026 Composite indices Public tasks plus a private test set
Last model added Aug 2026
Scores refreshed 2 Nov 2026
- Level
- Everyday Most adults, without training
- Scored
- Checked automatically A program checks the result against an answer key, unit tests or the expected final state.
- Answers
- Prediction Probabilities for events that have not happened yet.
244
Entries on its own leaderboard, 3 models we track
KnowLine 31B Gen1 tops the leaderboard with 71.9
Best score per entry from the benchmark's own leaderboard, read on 2 Nov 2026. Where a model ran with several settings or harnesses, we keep its best. Names in gray aren't in our model list: fine-tunes, agent systems, products and older models. They don't count toward leaders. The best model we track is Gemma 4 31B IT, at 67.6.
The newest model with a score here came out in Aug 2026, and nobody has tested a newer one. Among the 20 highest-ranked models on the capability index, these have no score yet:
- GPT-6 Astra
- Claude Opus 5.5
- GPT-6.1 Terra
- GPT-6.1 Sol
- and 16 more
- 71.9 KnowLine 31B Gen1
- 71.5 Fastino GLiDE 1.2
- 71.1 Sieve 31B v3
- 70.5 Turion Jev 31B
- 70.2 vLLM-SR d3-ultra (Decision 3.0, 27B)
- 69.8 Jeffan-31b-1710
- 68.6 H2O Lightning 31B v1.1
- 68.5 WeMM-JEV-27B
- 68.4 baselabs mammoth-1 (27B)
- 68.2 Ainvest-Decision-27B v1.0
- 68.1 oenogarum (Gemma 4 31B)
- 68.0 Perplexity Decider v1.2 (27B)
- 68.0 AutoTrust-JEV-27B v1.1
- 67.9 StartLux-Decision v1.1 27B
- 67.6 MISA AI 2.0 Decision Plus · oak 1.1 (31B)
- 67.6 AJev lm6q (Gemma 4 31B)
- 67.6 Gemma 4 31B IT
- 67.3 Lychee-27B
- 67.3 vLLM-SR d3-turbo v1.1 (27B)
- 67.2 vLLM-SR d3 (27B)
- 67.0 allec-oavg (Gemma 4 31B)
- 66.9 VisionJEV 1.0.0 (27B)
- 66.7 Aleria Judge 1.1.1 (Gemma 4 31B)
- 66.6 Nace.AI Drex Max v1 (27B)
- 66.6 Bespoke Nimble v4 Max (27B)
- 66.5 AnyJev Tacitus 31B
- 66.0 Decider 31B (NVFP4)
- 65.8 KnowLine 35B-A3B Gen1.5
- 65.7 OneShot 27B
- 65.3 vera-large
- 64.8 Bobcat 1.3 (31B)
- 64.8 Amos 1 Large (27B)
- 64.8 Matilda Decision v1
- 64.6 KnowLine 26B-A4B Gen2.5
- 64.4 frontier-infra Jebadiah 27B v2.1 (t1e)
- 63.0 deck31b (Gemma 4 31B)
- 63.0 Darwin-27B-ZTC
- 62.7 decisio 0.6.0 (Gemma 4 31B)
- 61.7 Cerno 27B
- 61.5 Torchcast Decision 27B
- 61.5 OneJev1.6-27B
- 61.1 Qwen Decision 27B noncausal LoRA
- 60.8 Quyet-1.0-Large
- 60.3 garum (Gemma 4 31B)
- 60.3 baselabs elephant-1 (9B)
- 60.1 Standard One 35B SH (v1)
- 60.0 Lumma-fev-27B
- 59.9 Sieve 27B v2
- 59.8 mogan-decision-31B-it
- 59.6 linne-fern 1.0 (27B)
- 59.6 Kev 27B
- 59.4 Xor 26B-A4B v1.2
- 59.2 Jev 1.13
- 59.1 span-02 (Gemma 4 26B-A4B)
- 59.0 garas (Gemma 4 31B)
- 58.8 Shisa DE-2.1 (repeat)
- 58.8 Eikos-27B
- 58.8 reflex Qwen3.8-27B-FP8 (pmscr)
- 58.6 RSI-Jev v6.1 VL 27B (effort auto)
- 58.4 KnowLine 9B Gen1
- 58.1 StartLux-Decision v1.1 9B
- 58.0 vLLM-SR Decision 2.0 Vega 27B
- 57.6 JEV-35B
- 57.4 JEV-27B
- 57.0
Qwen 3.8 27B - 56.6 Tern-35B-A3B
- 56.4 Surogate Rune 26B-A4B v3
- 56.2 SynACK Decide 26B-A4B v7
- 56.0 KnowLine 4B Gen5.5
- 55.9 Blink v0.3 26B-A4B (NVFP4)
- 55.6 JADE
- 55.4 Wald-26B-A4B
- 55.3 AJev lora1 (Gemma 4 26B-A4B)
- 54.9 Cloudflare clef
- 54.8 StartLux-Decision v1.1 4B
- 54.7 Qwen3.6 27B
- 54.3 Perplexity Decider Flash v1.2 (4B)
- 54.3 vLLM-SR d3-flash (9B)
- 54.1 JPT-35B-A3B
- 53.6 Xor 1.2
- 53.5 GEV-26B-Decide
- 53.0 OneJev1.6-9B
- 52.8 Nace.AI Drex v2.0 (35B-A3B)
- 52.5 muria (Gemma 4 12B)
- 52.2 Jeffan-4B-2010
- 52.0 Verdin-4B v1.1
- 51.1 Bespoke Nimble 9B v3
- 51.0 Senova-4B v2
- 50.9 frontier-infra Jebadiah 9B v2.1 (t1e)
- 50.8 decisio 0.4.0 (Qwen3.6-35B-A3B)
- 50.0 vLLM-SR d3-mini (4B)
- 49.5 JoshuaSP diffusiongemma (open-jev)
- 48.9 AJev lora7 (Gemma 4 12B)
- 48.9 OneJev1.6-4B
- 48.8 decisio 0.4.0 (Gemma 4 12B)
- 47.7 Mica v0.5 4B
- 47.5 PurpleMIST-Flash-1.0
- 47.3 Cerno 9B v1.1
- 47.0 Sieve 9B v2
- 46.6 Decider 35B-A3B
- 46.6 Winnow-12B
- 46.3 Seb-9B v2
- 46.0 vLLM-SR Decision 2.0 Lux 9B
- 45.8 Nace.AI Drex v1.5
- 45.8 Hopper 12B (trained)
- 45.6 Trio-Spark DI (9B)
- 45.5 CoCo-Decision-4B 2.4
- 45.0 Cloudflare clef-omni (30B-A3B)
- 44.9 JevK5 9B v0.3.3
- 44.4 Cloudflare clef-flash
- 44.4 Jevfire
- 44.3 RSI-Jev v6.1 VL 4B
- 44.2 Jegue 0.1 (9B)
- 44.1 jiwo 4B v2
- 44.1 JPT-9B
- 43.9 ezjev 4B s2
- 43.8 Jev-Omni
- 43.2 Solomon v1.1
- 42.9 Standard One 8B SH (v4)
- 42.7 Amber Hybrid 4B
- 42.5 Saif 4B
- 42.1 JEV-9B
- 42.1 Bespoke Nimble 9B v2
- 41.7 Sieve 9B
- 41.1 Cerno 4B v1.1
- 41.0 Sieve 4B
- 40.9 Kev 9B v2
- 40.9 Nari Decision 4B v3.2
- 40.8 Aplomb 1
- 40.8 vLLM-SR Decision 2.0 Nox 4B
- 40.2 Hopper (G) 1.2
- 40.1 StartLux-Decision v1.1 2B
- 39.8 FlyMy.AI Decision 4B v1.6
- 39.8 Standard One 3B SH (v4)
- 39.6 JPT-4B
- 39.5 Amber 4B
- 38.7 Intern-Decision-4B
- 38.6 RSI-Jev v5.0 VL 3B
- 38.1 djev
- 37.9 Valen-4B
- 37.6 razorback16 openjev diffusiongemma (NVFP4, vLLM)
- 37.3 NeoHorse-Jev-4B
- 36.6 JevK5 v0.3
- 36.3 Decider 4B
- 35.9 baselabs joey-1 (2B)
- 35.5 lev
- 35.4 Lev1 3.7B
- 34.9 Kev 4B r10
- 34.5 Jev-Style 2B v4
- 34.5 Sieve 2B v3
- 34.4 LatentMesh Blitz 2B v1
- 34.4 Saracura PT-BR 4B
- 34.4 Cam1
- 34.3 vLLM-SR d3-nano (2B)
- 34.3 mmastrac diffusiongemma (vLLM PR 57250)
- 34.0 Kas 4B
- 33.7 Tev1-4B-experimental
- 32.7 Winnow-E4B
- 32.5 Aurelis-2B
- 32.2 Jevstral 8B
- 32.2 Metask-Jev-4B
- 32.0 Ryotide Qwen v0.3.1
- 31.3 Intelif Qwen3-4B
- 31.2 GLiClass v4 edge (0.4B)
- 31.1 LiquidAI d1-3B
- 31.1 open-jev (pngwn)
- 30.6 vera-core-2
- 30.4 Jobe
- 29.6 OneJev1.6-0.8B
- 29.4 crystal-0.8b
- 29.3 vLLM-SR vela3-fast (Vela 3.0, 0.4B)
- 29.3 Crivo-1B
- 29.2 Gevva E4B
- 28.9 StartLux-Decision v1.1 0.8B
- 28.8 openvons
- 26.7 SemIf
- 26.5 Saina Helm 2 Omni (0.8B)
- 26.2 vLLM-SR d3-lite (0.8B)
- 26.0 Amber 0.4B
- 25.8 jiwo 0.8B v2
- 25.3 Saina Helm 2.0 v2
- 24.9 this-that 1.2
- 24.3 Gevva E2B
- 23.7 Crivo-400M
- 23.6 Decider 2B
- 23.6 vLLM-SR Decision 2.0 Sol 2B
- 23.6 jdi-ptr14-0.8b
- 22.8 mini-jev
- 22.2 Valen-2B
- 22.1 vLLM-SR vela3-fast-vision (Vela 3.0, 0.25B)
- 21.9 Sieve 2B
- 21.5 wyat-1-800m
- 20.9 Intern-Decision-2B
- 20.8 Sieve 0.8B
- 20.7 Strands Decider 2B
- 20.6 EXAONE-4.0-1.2B-JEV v0.3
- 19.9 tasksource Decider nano v5 (150M)
- 19.5 Crivo-68M
- 18.5 JEV Ettin 150M
- 18.4 vLLM-SR Decision 2.0 Eos 0.8B
- 18.3 Crivo-150M v2
- 18.0 Bekko System One v0 400M
- 17.8 Mola-150M
- 17.7 vLLM-SR d3-edge (0.6B)
- 17.6 Mola-68M
- 17.3 JEV FLAN-T5 Large public v2 (342M)
- 17.2 DecisionTune 1.0
- 16.6 Valen-0.8B
- 16.5 Bosun v3.1 1.7B
- 16.4 vLLM-SR Decision 2.0 Kai 0.6B
- 16.4 Dinah-1
- 16.3 Kev 0.8B r15
- 15.6 PICK-150M v5
- 15.5 JPT-0.8B
- 15.2 JEV Ettin 400M
- 14.5 Sifr 0.8B v3.1
- 14.2 Crivo-32M v2
- 14.0 Prumo
- 13.9 Kodiak v0.2 1B (accuracy)
- 12.7 Intern-Decision-0.8B
- 12.5 Jev-Style 0.8B v3
- 12.5 Tev1-0.8B-experimental
- 12.4 Bekko System One v0 68M
- 11.8 LiquidAI d1-omni-600M
- 11.7 Crivo-17M
- 11.7 Von 1.3
- 11.0 Bosun v3.1 0.6B
- 11.0 vera-spark
- 10.8 Lavoir
- 10.1 GLiNER2.5-Decide
- 9.2 Laya
- 8.8 JevK5 Lite
- 8.2 LFM2.5-2.6B-RLCD
- 7.8 Qwen-2.5-1B-RLCD
- 7.7 Bekko System One v0 17M
- 6.5 CLM-v0.1-8B
- 6.2 jeff
- 5.9 LFM2.5-350M-RLCD
- 5.2 system-one-gemma
- 5.0 DM-JEPA 1.1
- 4.8 Julia 1
- 3.5 Nirnaya 0.4B
- 3.4 Zev
- 2.0 Verdict
- 1 KnowLine 31B Gen1 71.9
- 2 Fastino GLiDE 1.2 71.5
- 3 Sieve 31B v3 71.1
- 4 Turion Jev 31B 70.5
- 5 vLLM-SR d3-ultra (Decision 3.0, 27B) 70.2
- 6 Jeffan-31b-1710 69.8
- 7 H2O Lightning 31B v1.1 68.6
- 8 WeMM-JEV-27B 68.5
- 9 baselabs mammoth-1 (27B) 68.4
- 10 Ainvest-Decision-27B v1.0 68.2
- 11 oenogarum (Gemma 4 31B) 68.1
- 12 Perplexity Decider v1.2 (27B) 68.0
- 13 AutoTrust-JEV-27B v1.1 68.0
- 14 StartLux-Decision v1.1 27B 67.9
- 15 MISA AI 2.0 Decision Plus · oak 1.1 (31B) 67.6
- 16 AJev lm6q (Gemma 4 31B) 67.6
- 17 Gemma 4 31B IT 67.6
- 18 Lychee-27B 67.3
- 19 vLLM-SR d3-turbo v1.1 (27B) 67.3
- 20 vLLM-SR d3 (27B) 67.2
- 21 allec-oavg (Gemma 4 31B) 67.0
- 22 VisionJEV 1.0.0 (27B) 66.9
- 23 Aleria Judge 1.1.1 (Gemma 4 31B) 66.7
- 24 Nace.AI Drex Max v1 (27B) 66.6
- 25 Bespoke Nimble v4 Max (27B) 66.6
- 26 AnyJev Tacitus 31B 66.5
- 27 Decider 31B (NVFP4) 66.0
- 28 KnowLine 35B-A3B Gen1.5 65.8
- 29 OneShot 27B 65.7
- 30 vera-large 65.3
- 31 Bobcat 1.3 (31B) 64.8
- 32 Amos 1 Large (27B) 64.8
- 33 Matilda Decision v1 64.8
- 34 KnowLine 26B-A4B Gen2.5 64.6
- 35 frontier-infra Jebadiah 27B v2.1 (t1e) 64.4
- 36 deck31b (Gemma 4 31B) 63.0
- 37 Darwin-27B-ZTC 63.0
- 38 decisio 0.6.0 (Gemma 4 31B) 62.7
- 39 Cerno 27B 61.7
- 40 Torchcast Decision 27B 61.5
- 41 OneJev1.6-27B 61.5
- 42 Qwen Decision 27B noncausal LoRA 61.1
- 43 Quyet-1.0-Large 60.8
- 44 garum (Gemma 4 31B) 60.3
- 45 baselabs elephant-1 (9B) 60.3
- 46 Standard One 35B SH (v1) 60.1
- 47 Lumma-fev-27B 60.0
- 48 Sieve 27B v2 59.9
- 49 mogan-decision-31B-it 59.8
- 50 linne-fern 1.0 (27B) 59.6
- 51 Kev 27B 59.6
- 52 Xor 26B-A4B v1.2 59.4
- 53 Jev 1.13 59.2
- 54 span-02 (Gemma 4 26B-A4B) 59.1
- 55 garas (Gemma 4 31B) 59.0
- 56 Shisa DE-2.1 (repeat) 58.8
- 57 Eikos-27B 58.8
- 58 reflex Qwen3.8-27B-FP8 (pmscr) 58.8
- 59 RSI-Jev v6.1 VL 27B (effort auto) 58.6
- 60 KnowLine 9B Gen1 58.4
- 61 StartLux-Decision v1.1 9B 58.1
- 62 vLLM-SR Decision 2.0 Vega 27B 58.0
- 63 JEV-35B 57.6
- 64 JEV-27B 57.4
- 65 Qwen 3.8 27B 57.0
- 66 Tern-35B-A3B 56.6
- 67 Surogate Rune 26B-A4B v3 56.4
- 68 SynACK Decide 26B-A4B v7 56.2
- 69 KnowLine 4B Gen5.5 56.0
- 70 Blink v0.3 26B-A4B (NVFP4) 55.9
- 71 JADE 55.6
- 72 Wald-26B-A4B 55.4
- 73 AJev lora1 (Gemma 4 26B-A4B) 55.3
- 74 Cloudflare clef 54.9
- 75 StartLux-Decision v1.1 4B 54.8
- 76 Qwen3.6 27B 54.7
- 77 Perplexity Decider Flash v1.2 (4B) 54.3
- 78 vLLM-SR d3-flash (9B) 54.3
- 79 JPT-35B-A3B 54.1
- 80 Xor 1.2 53.6
- 81 GEV-26B-Decide 53.5
- 82 OneJev1.6-9B 53.0
- 83 Nace.AI Drex v2.0 (35B-A3B) 52.8
- 84 muria (Gemma 4 12B) 52.5
- 85 Jeffan-4B-2010 52.2
- 86 Verdin-4B v1.1 52.0
- 87 Bespoke Nimble 9B v3 51.1
- 88 Senova-4B v2 51.0
- 89 frontier-infra Jebadiah 9B v2.1 (t1e) 50.9
- 90 decisio 0.4.0 (Qwen3.6-35B-A3B) 50.8
- 91 vLLM-SR d3-mini (4B) 50.0
- 92 JoshuaSP diffusiongemma (open-jev) 49.5
- 93 AJev lora7 (Gemma 4 12B) 48.9
- 94 OneJev1.6-4B 48.9
- 95 decisio 0.4.0 (Gemma 4 12B) 48.8
- 96 Mica v0.5 4B 47.7
- 97 PurpleMIST-Flash-1.0 47.5
- 98 Cerno 9B v1.1 47.3
- 99 Sieve 9B v2 47.0
- 100 Decider 35B-A3B 46.6
- 101 Winnow-12B 46.6
- 102 Seb-9B v2 46.3
- 103 vLLM-SR Decision 2.0 Lux 9B 46.0
- 104 Nace.AI Drex v1.5 45.8
- 105 Hopper 12B (trained) 45.8
- 106 Trio-Spark DI (9B) 45.6
- 107 CoCo-Decision-4B 2.4 45.5
- 108 Cloudflare clef-omni (30B-A3B) 45.0
- 109 JevK5 9B v0.3.3 44.9
- 110 Cloudflare clef-flash 44.4
- 111 Jevfire 44.4
- 112 RSI-Jev v6.1 VL 4B 44.3
- 113 Jegue 0.1 (9B) 44.2
- 114 jiwo 4B v2 44.1
- 115 JPT-9B 44.1
- 116 ezjev 4B s2 43.9
- 117 Jev-Omni 43.8
- 118 Solomon v1.1 43.2
- 119 Standard One 8B SH (v4) 42.9
- 120 Amber Hybrid 4B 42.7
- 121 Saif 4B 42.5
- 122 JEV-9B 42.1
- 123 Bespoke Nimble 9B v2 42.1
- 124 Sieve 9B 41.7
- 125 Cerno 4B v1.1 41.1
- 126 Sieve 4B 41.0
- 127 Kev 9B v2 40.9
- 128 Nari Decision 4B v3.2 40.9
- 129 Aplomb 1 40.8
- 130 vLLM-SR Decision 2.0 Nox 4B 40.8
- 131 Hopper (G) 1.2 40.2
- 132 StartLux-Decision v1.1 2B 40.1
- 133 FlyMy.AI Decision 4B v1.6 39.8
- 134 Standard One 3B SH (v4) 39.8
- 135 JPT-4B 39.6
- 136 Amber 4B 39.5
- 137 Intern-Decision-4B 38.7
- 138 RSI-Jev v5.0 VL 3B 38.6
- 139 djev 38.1
- 140 Valen-4B 37.9
- 141 razorback16 openjev diffusiongemma (NVFP4, vLLM) 37.6
- 142 NeoHorse-Jev-4B 37.3
- 143 JevK5 v0.3 36.6
- 144 Decider 4B 36.3
- 145 baselabs joey-1 (2B) 35.9
- 146 lev 35.5
- 147 Lev1 3.7B 35.4
- 148 Kev 4B r10 34.9
- 149 Jev-Style 2B v4 34.5
- 150 Sieve 2B v3 34.5
- 151 LatentMesh Blitz 2B v1 34.4
- 152 Saracura PT-BR 4B 34.4
- 153 Cam1 34.4
- 154 vLLM-SR d3-nano (2B) 34.3
- 155 mmastrac diffusiongemma (vLLM PR 57250) 34.3
- 156 Kas 4B 34.0
- 157 Tev1-4B-experimental 33.7
- 158 Winnow-E4B 32.7
- 159 Aurelis-2B 32.5
- 160 Jevstral 8B 32.2
- 161 Metask-Jev-4B 32.2
- 162 Ryotide Qwen v0.3.1 32.0
- 163 Intelif Qwen3-4B 31.3
- 164 GLiClass v4 edge (0.4B) 31.2
- 165 LiquidAI d1-3B 31.1
- 166 open-jev (pngwn) 31.1
- 167 vera-core-2 30.6
- 168 Jobe 30.4
- 169 OneJev1.6-0.8B 29.6
- 170 crystal-0.8b 29.4
- 171 vLLM-SR vela3-fast (Vela 3.0, 0.4B) 29.3
- 172 Crivo-1B 29.3
- 173 Gevva E4B 29.2
- 174 StartLux-Decision v1.1 0.8B 28.9
- 175 openvons 28.8
- 176 SemIf 26.7
- 177 Saina Helm 2 Omni (0.8B) 26.5
- 178 vLLM-SR d3-lite (0.8B) 26.2
- 179 Amber 0.4B 26.0
- 180 jiwo 0.8B v2 25.8
- 181 Saina Helm 2.0 v2 25.3
- 182 this-that 1.2 24.9
- 183 Gevva E2B 24.3
- 184 Crivo-400M 23.7
- 185 Decider 2B 23.6
- 186 vLLM-SR Decision 2.0 Sol 2B 23.6
- 187 jdi-ptr14-0.8b 23.6
- 188 mini-jev 22.8
- 189 Valen-2B 22.2
- 190 vLLM-SR vela3-fast-vision (Vela 3.0, 0.25B) 22.1
- 191 Sieve 2B 21.9
- 192 wyat-1-800m 21.5
- 193 Intern-Decision-2B 20.9
- 194 Sieve 0.8B 20.8
- 195 Strands Decider 2B 20.7
- 196 EXAONE-4.0-1.2B-JEV v0.3 20.6
- 197 tasksource Decider nano v5 (150M) 19.9
- 198 Crivo-68M 19.5
- 199 JEV Ettin 150M 18.5
- 200 vLLM-SR Decision 2.0 Eos 0.8B 18.4
- 201 Crivo-150M v2 18.3
- 202 Bekko System One v0 400M 18.0
- 203 Mola-150M 17.8
- 204 vLLM-SR d3-edge (0.6B) 17.7
- 205 Mola-68M 17.6
- 206 JEV FLAN-T5 Large public v2 (342M) 17.3
- 207 DecisionTune 1.0 17.2
- 208 Valen-0.8B 16.6
- 209 Bosun v3.1 1.7B 16.5
- 210 vLLM-SR Decision 2.0 Kai 0.6B 16.4
- 211 Dinah-1 16.4
- 212 Kev 0.8B r15 16.3
- 213 PICK-150M v5 15.6
- 214 JPT-0.8B 15.5
- 215 JEV Ettin 400M 15.2
- 216 Sifr 0.8B v3.1 14.5
- 217 Crivo-32M v2 14.2
- 218 Prumo 14.0
- 219 Kodiak v0.2 1B (accuracy) 13.9
- 220 Intern-Decision-0.8B 12.7
- 221 Jev-Style 0.8B v3 12.5
- 222 Tev1-0.8B-experimental 12.5
- 223 Bekko System One v0 68M 12.4
- 224 LiquidAI d1-omni-600M 11.8
- 225 Crivo-17M 11.7
- 226 Von 1.3 11.7
- 227 Bosun v3.1 0.6B 11.0
- 228 vera-spark 11.0
- 229 Lavoir 10.8
- 230 GLiNER2.5-Decide 10.1
- 231 Laya 9.2
- 232 JevK5 Lite 8.8
- 233 LFM2.5-2.6B-RLCD 8.2
- 234 Qwen-2.5-1B-RLCD 7.8
- 235 Bekko System One v0 17M 7.7
- 236 CLM-v0.1-8B 6.5
- 237 jeff 6.2
- 238 LFM2.5-350M-RLCD 5.9
- 239 system-one-gemma 5.2
- 240 DM-JEPA 1.1 5.0
- 241 Julia 1 4.8
- 242 Nirnaya 0.4B 3.5
- 243 Zev 3.4
- 244 Verdict 2.0
| # | Entry | Score | Setting | Date | Source |
|---|---|---|---|---|---|
| 1 | KnowLine 31B Gen1 | 71.9 | Official leaderboard | ||
| 2 | Fastino GLiDE 1.2 | 71.5 | Official leaderboard | ||
| 3 | Sieve 31B v3 | 71.1 | Official leaderboard | ||
| 4 | Turion Jev 31B | 70.5 | Official leaderboard | ||
| 5 | vLLM-SR d3-ultra (Decision 3.0, 27B) | 70.2 | Official leaderboard | ||
| 6 | Jeffan-31b-1710 | 69.8 | Official leaderboard | ||
| 7 | H2O Lightning 31B v1.1 | 68.6 | Official leaderboard | ||
| 8 | WeMM-JEV-27B | 68.5 | Official leaderboard | ||
| 9 | baselabs mammoth-1 (27B) | 68.4 | Official leaderboard | ||
| 10 | Ainvest-Decision-27B v1.0 | 68.2 | Official leaderboard | ||
| 11 | oenogarum (Gemma 4 31B) | 68.1 | Official leaderboard | ||
| 12 | Perplexity Decider v1.2 (27B) | 68.0 | Official leaderboard | ||
| 13 | AutoTrust-JEV-27B v1.1 | 68.0 | Official leaderboard | ||
| 14 | StartLux-Decision v1.1 27B | 67.9 | Official leaderboard | ||
| 15 | MISA AI 2.0 Decision Plus · oak 1.1 (31B) | 67.6 | Official leaderboard | ||
| 16 | AJev lm6q (Gemma 4 31B) | 67.6 | Official leaderboard | ||
| 17 | Gemma 4 31B IT | 67.6 | FlexDM | Apr 2026 | Official leaderboard |
| 18 | Lychee-27B | 67.3 | Official leaderboard | ||
| 19 | vLLM-SR d3-turbo v1.1 (27B) | 67.3 | Official leaderboard | ||
| 20 | vLLM-SR d3 (27B) | 67.2 | Official leaderboard | ||
| 21 | allec-oavg (Gemma 4 31B) | 67.0 | Official leaderboard | ||
| 22 | VisionJEV 1.0.0 (27B) | 66.9 | Official leaderboard | ||
| 23 | Aleria Judge 1.1.1 (Gemma 4 31B) | 66.7 | Official leaderboard | ||
| 24 | Nace.AI Drex Max v1 (27B) | 66.6 | Official leaderboard | ||
| 25 | Bespoke Nimble v4 Max (27B) | 66.6 | Official leaderboard | ||
| 26 | AnyJev Tacitus 31B | 66.5 | Official leaderboard | ||
| 27 | Decider 31B (NVFP4) | 66.0 | Official leaderboard | ||
| 28 | KnowLine 35B-A3B Gen1.5 | 65.8 | Official leaderboard | ||
| 29 | OneShot 27B | 65.7 | Official leaderboard | ||
| 30 | vera-large | 65.3 | Official leaderboard | ||
| 31 | Bobcat 1.3 (31B) | 64.8 | Official leaderboard | ||
| 32 | Amos 1 Large (27B) | 64.8 | Official leaderboard | ||
| 33 | Matilda Decision v1 | 64.8 | Official leaderboard | ||
| 34 | KnowLine 26B-A4B Gen2.5 | 64.6 | Official leaderboard | ||
| 35 | frontier-infra Jebadiah 27B v2.1 (t1e) | 64.4 | Official leaderboard | ||
| 36 | deck31b (Gemma 4 31B) | 63.0 | Official leaderboard | ||
| 37 | Darwin-27B-ZTC | 63.0 | Official leaderboard | ||
| 38 | decisio 0.6.0 (Gemma 4 31B) | 62.7 | Official leaderboard | ||
| 39 | Cerno 27B | 61.7 | Official leaderboard | ||
| 40 | Torchcast Decision 27B | 61.5 | Official leaderboard | ||
| 41 | OneJev1.6-27B | 61.5 | Official leaderboard | ||
| 42 | Qwen Decision 27B noncausal LoRA | 61.1 | Official leaderboard | ||
| 43 | Quyet-1.0-Large | 60.8 | Official leaderboard | ||
| 44 | garum (Gemma 4 31B) | 60.3 | Official leaderboard | ||
| 45 | baselabs elephant-1 (9B) | 60.3 | Official leaderboard | ||
| 46 | Standard One 35B SH (v1) | 60.1 | Official leaderboard | ||
| 47 | Lumma-fev-27B | 60.0 | Official leaderboard | ||
| 48 | Sieve 27B v2 | 59.9 | Official leaderboard | ||
| 49 | mogan-decision-31B-it | 59.8 | Official leaderboard | ||
| 50 | linne-fern 1.0 (27B) | 59.6 | Official leaderboard | ||
| 51 | Kev 27B | 59.6 | Official leaderboard | ||
| 52 | Xor 26B-A4B v1.2 | 59.4 | Official leaderboard | ||
| 53 | Jev 1.13 | 59.2 | Official leaderboard | ||
| 54 | span-02 (Gemma 4 26B-A4B) | 59.1 | Official leaderboard | ||
| 55 | garas (Gemma 4 31B) | 59.0 | Official leaderboard | ||
| 56 | Shisa DE-2.1 (repeat) | 58.8 | Official leaderboard | ||
| 57 | Eikos-27B | 58.8 | Official leaderboard | ||
| 58 | reflex Qwen3.8-27B-FP8 (pmscr) | 58.8 | Official leaderboard | ||
| 59 | RSI-Jev v6.1 VL 27B (effort auto) | 58.6 | Official leaderboard | ||
| 60 | KnowLine 9B Gen1 | 58.4 | Official leaderboard | ||
| 61 | StartLux-Decision v1.1 9B | 58.1 | Official leaderboard | ||
| 62 | vLLM-SR Decision 2.0 Vega 27B | 58.0 | Official leaderboard | ||
| 63 | JEV-35B | 57.6 | Official leaderboard | ||
| 64 | JEV-27B | 57.4 | Official leaderboard | ||
| 65 | Qwen 3.8 27B | 57.0 | simple-jev | Aug 2026 | Official leaderboard |
| 66 | Tern-35B-A3B | 56.6 | Official leaderboard | ||
| 67 | Surogate Rune 26B-A4B v3 | 56.4 | Official leaderboard | ||
| 68 | SynACK Decide 26B-A4B v7 | 56.2 | Official leaderboard | ||
| 69 | KnowLine 4B Gen5.5 | 56.0 | Official leaderboard | ||
| 70 | Blink v0.3 26B-A4B (NVFP4) | 55.9 | Official leaderboard | ||
| 71 | JADE | 55.6 | Official leaderboard | ||
| 72 | Wald-26B-A4B | 55.4 | Official leaderboard | ||
| 73 | AJev lora1 (Gemma 4 26B-A4B) | 55.3 | Official leaderboard | ||
| 74 | Cloudflare clef | 54.9 | Official leaderboard | ||
| 75 | StartLux-Decision v1.1 4B | 54.8 | Official leaderboard | ||
| 76 | Qwen3.6 27B | 54.7 | Decider chat | Apr 2026 | Official leaderboard |
| 77 | Perplexity Decider Flash v1.2 (4B) | 54.3 | Official leaderboard | ||
| 78 | vLLM-SR d3-flash (9B) | 54.3 | Official leaderboard | ||
| 79 | JPT-35B-A3B | 54.1 | Official leaderboard | ||
| 80 | Xor 1.2 | 53.6 | Official leaderboard | ||
| 81 | GEV-26B-Decide | 53.5 | Official leaderboard | ||
| 82 | OneJev1.6-9B | 53.0 | Official leaderboard | ||
| 83 | Nace.AI Drex v2.0 (35B-A3B) | 52.8 | Official leaderboard | ||
| 84 | muria (Gemma 4 12B) | 52.5 | Official leaderboard | ||
| 85 | Jeffan-4B-2010 | 52.2 | Official leaderboard | ||
| 86 | Verdin-4B v1.1 | 52.0 | Official leaderboard | ||
| 87 | Bespoke Nimble 9B v3 | 51.1 | Official leaderboard | ||
| 88 | Senova-4B v2 | 51.0 | Official leaderboard | ||
| 89 | frontier-infra Jebadiah 9B v2.1 (t1e) | 50.9 | Official leaderboard | ||
| 90 | decisio 0.4.0 (Qwen3.6-35B-A3B) | 50.8 | Official leaderboard | ||
| 91 | vLLM-SR d3-mini (4B) | 50.0 | Official leaderboard | ||
| 92 | JoshuaSP diffusiongemma (open-jev) | 49.5 | Official leaderboard | ||
| 93 | AJev lora7 (Gemma 4 12B) | 48.9 | Official leaderboard | ||
| 94 | OneJev1.6-4B | 48.9 | Official leaderboard | ||
| 95 | decisio 0.4.0 (Gemma 4 12B) | 48.8 | Official leaderboard | ||
| 96 | Mica v0.5 4B | 47.7 | Official leaderboard | ||
| 97 | PurpleMIST-Flash-1.0 | 47.5 | Official leaderboard | ||
| 98 | Cerno 9B v1.1 | 47.3 | Official leaderboard | ||
| 99 | Sieve 9B v2 | 47.0 | Official leaderboard | ||
| 100 | Decider 35B-A3B | 46.6 | Official leaderboard | ||
| 101 | Winnow-12B | 46.6 | Official leaderboard | ||
| 102 | Seb-9B v2 | 46.3 | Official leaderboard | ||
| 103 | vLLM-SR Decision 2.0 Lux 9B | 46.0 | Official leaderboard | ||
| 104 | Nace.AI Drex v1.5 | 45.8 | Official leaderboard | ||
| 105 | Hopper 12B (trained) | 45.8 | Official leaderboard | ||
| 106 | Trio-Spark DI (9B) | 45.6 | Official leaderboard | ||
| 107 | CoCo-Decision-4B 2.4 | 45.5 | Official leaderboard | ||
| 108 | Cloudflare clef-omni (30B-A3B) | 45.0 | Official leaderboard | ||
| 109 | JevK5 9B v0.3.3 | 44.9 | Official leaderboard | ||
| 110 | Cloudflare clef-flash | 44.4 | Official leaderboard | ||
| 111 | Jevfire | 44.4 | Official leaderboard | ||
| 112 | RSI-Jev v6.1 VL 4B | 44.3 | Official leaderboard | ||
| 113 | Jegue 0.1 (9B) | 44.2 | Official leaderboard | ||
| 114 | jiwo 4B v2 | 44.1 | Official leaderboard | ||
| 115 | JPT-9B | 44.1 | Official leaderboard | ||
| 116 | ezjev 4B s2 | 43.9 | Official leaderboard | ||
| 117 | Jev-Omni | 43.8 | Official leaderboard | ||
| 118 | Solomon v1.1 | 43.2 | Official leaderboard | ||
| 119 | Standard One 8B SH (v4) | 42.9 | Official leaderboard | ||
| 120 | Amber Hybrid 4B | 42.7 | Official leaderboard | ||
| 121 | Saif 4B | 42.5 | Official leaderboard | ||
| 122 | JEV-9B | 42.1 | Official leaderboard | ||
| 123 | Bespoke Nimble 9B v2 | 42.1 | Official leaderboard | ||
| 124 | Sieve 9B | 41.7 | Official leaderboard | ||
| 125 | Cerno 4B v1.1 | 41.1 | Official leaderboard | ||
| 126 | Sieve 4B | 41.0 | Official leaderboard | ||
| 127 | Kev 9B v2 | 40.9 | Official leaderboard | ||
| 128 | Nari Decision 4B v3.2 | 40.9 | Official leaderboard | ||
| 129 | Aplomb 1 | 40.8 | Official leaderboard | ||
| 130 | vLLM-SR Decision 2.0 Nox 4B | 40.8 | Official leaderboard | ||
| 131 | Hopper (G) 1.2 | 40.2 | Official leaderboard | ||
| 132 | StartLux-Decision v1.1 2B | 40.1 | Official leaderboard | ||
| 133 | FlyMy.AI Decision 4B v1.6 | 39.8 | Official leaderboard | ||
| 134 | Standard One 3B SH (v4) | 39.8 | Official leaderboard | ||
| 135 | JPT-4B | 39.6 | Official leaderboard | ||
| 136 | Amber 4B | 39.5 | Official leaderboard | ||
| 137 | Intern-Decision-4B | 38.7 | Official leaderboard | ||
| 138 | RSI-Jev v5.0 VL 3B | 38.6 | Official leaderboard | ||
| 139 | djev | 38.1 | Official leaderboard | ||
| 140 | Valen-4B | 37.9 | Official leaderboard | ||
| 141 | razorback16 openjev diffusiongemma (NVFP4, vLLM) | 37.6 | Official leaderboard | ||
| 142 | NeoHorse-Jev-4B | 37.3 | Official leaderboard | ||
| 143 | JevK5 v0.3 | 36.6 | Official leaderboard | ||
| 144 | Decider 4B | 36.3 | Official leaderboard | ||
| 145 | baselabs joey-1 (2B) | 35.9 | Official leaderboard | ||
| 146 | lev | 35.5 | Official leaderboard | ||
| 147 | Lev1 3.7B | 35.4 | Official leaderboard | ||
| 148 | Kev 4B r10 | 34.9 | Official leaderboard | ||
| 149 | Jev-Style 2B v4 | 34.5 | Official leaderboard | ||
| 150 | Sieve 2B v3 | 34.5 | Official leaderboard | ||
| 151 | LatentMesh Blitz 2B v1 | 34.4 | Official leaderboard | ||
| 152 | Saracura PT-BR 4B | 34.4 | Official leaderboard | ||
| 153 | Cam1 | 34.4 | Official leaderboard | ||
| 154 | vLLM-SR d3-nano (2B) | 34.3 | Official leaderboard | ||
| 155 | mmastrac diffusiongemma (vLLM PR 57250) | 34.3 | Official leaderboard | ||
| 156 | Kas 4B | 34.0 | Official leaderboard | ||
| 157 | Tev1-4B-experimental | 33.7 | Official leaderboard | ||
| 158 | Winnow-E4B | 32.7 | Official leaderboard | ||
| 159 | Aurelis-2B | 32.5 | Official leaderboard | ||
| 160 | Jevstral 8B | 32.2 | Official leaderboard | ||
| 161 | Metask-Jev-4B | 32.2 | Official leaderboard | ||
| 162 | Ryotide Qwen v0.3.1 | 32.0 | Official leaderboard | ||
| 163 | Intelif Qwen3-4B | 31.3 | Official leaderboard | ||
| 164 | GLiClass v4 edge (0.4B) | 31.2 | Official leaderboard | ||
| 165 | LiquidAI d1-3B | 31.1 | Official leaderboard | ||
| 166 | open-jev (pngwn) | 31.1 | Official leaderboard | ||
| 167 | vera-core-2 | 30.6 | Official leaderboard | ||
| 168 | Jobe | 30.4 | Official leaderboard | ||
| 169 | OneJev1.6-0.8B | 29.6 | Official leaderboard | ||
| 170 | crystal-0.8b | 29.4 | Official leaderboard | ||
| 171 | vLLM-SR vela3-fast (Vela 3.0, 0.4B) | 29.3 | Official leaderboard | ||
| 172 | Crivo-1B | 29.3 | Official leaderboard | ||
| 173 | Gevva E4B | 29.2 | Official leaderboard | ||
| 174 | StartLux-Decision v1.1 0.8B | 28.9 | Official leaderboard | ||
| 175 | openvons | 28.8 | Official leaderboard | ||
| 176 | SemIf | 26.7 | Official leaderboard | ||
| 177 | Saina Helm 2 Omni (0.8B) | 26.5 | Official leaderboard | ||
| 178 | vLLM-SR d3-lite (0.8B) | 26.2 | Official leaderboard | ||
| 179 | Amber 0.4B | 26.0 | Official leaderboard | ||
| 180 | jiwo 0.8B v2 | 25.8 | Official leaderboard | ||
| 181 | Saina Helm 2.0 v2 | 25.3 | Official leaderboard | ||
| 182 | this-that 1.2 | 24.9 | Official leaderboard | ||
| 183 | Gevva E2B | 24.3 | Official leaderboard | ||
| 184 | Crivo-400M | 23.7 | Official leaderboard | ||
| 185 | Decider 2B | 23.6 | Official leaderboard | ||
| 186 | vLLM-SR Decision 2.0 Sol 2B | 23.6 | Official leaderboard | ||
| 187 | jdi-ptr14-0.8b | 23.6 | Official leaderboard | ||
| 188 | mini-jev | 22.8 | Official leaderboard | ||
| 189 | Valen-2B | 22.2 | Official leaderboard | ||
| 190 | vLLM-SR vela3-fast-vision (Vela 3.0, 0.25B) | 22.1 | Official leaderboard | ||
| 191 | Sieve 2B | 21.9 | Official leaderboard | ||
| 192 | wyat-1-800m | 21.5 | Official leaderboard | ||
| 193 | Intern-Decision-2B | 20.9 | Official leaderboard | ||
| 194 | Sieve 0.8B | 20.8 | Official leaderboard | ||
| 195 | Strands Decider 2B | 20.7 | Official leaderboard | ||
| 196 | EXAONE-4.0-1.2B-JEV v0.3 | 20.6 | Official leaderboard | ||
| 197 | tasksource Decider nano v5 (150M) | 19.9 | Official leaderboard | ||
| 198 | Crivo-68M | 19.5 | Official leaderboard | ||
| 199 | JEV Ettin 150M | 18.5 | Official leaderboard | ||
| 200 | vLLM-SR Decision 2.0 Eos 0.8B | 18.4 | Official leaderboard | ||
| 201 | Crivo-150M v2 | 18.3 | Official leaderboard | ||
| 202 | Bekko System One v0 400M | 18.0 | Official leaderboard | ||
| 203 | Mola-150M | 17.8 | Official leaderboard | ||
| 204 | vLLM-SR d3-edge (0.6B) | 17.7 | Official leaderboard | ||
| 205 | Mola-68M | 17.6 | Official leaderboard | ||
| 206 | JEV FLAN-T5 Large public v2 (342M) | 17.3 | Official leaderboard | ||
| 207 | DecisionTune 1.0 | 17.2 | Official leaderboard | ||
| 208 | Valen-0.8B | 16.6 | Official leaderboard | ||
| 209 | Bosun v3.1 1.7B | 16.5 | Official leaderboard | ||
| 210 | vLLM-SR Decision 2.0 Kai 0.6B | 16.4 | Official leaderboard | ||
| 211 | Dinah-1 | 16.4 | Official leaderboard | ||
| 212 | Kev 0.8B r15 | 16.3 | Official leaderboard | ||
| 213 | PICK-150M v5 | 15.6 | Official leaderboard | ||
| 214 | JPT-0.8B | 15.5 | Official leaderboard | ||
| 215 | JEV Ettin 400M | 15.2 | Official leaderboard | ||
| 216 | Sifr 0.8B v3.1 | 14.5 | Official leaderboard | ||
| 217 | Crivo-32M v2 | 14.2 | Official leaderboard | ||
| 218 | Prumo | 14.0 | Official leaderboard | ||
| 219 | Kodiak v0.2 1B (accuracy) | 13.9 | Official leaderboard | ||
| 220 | Intern-Decision-0.8B | 12.7 | Official leaderboard | ||
| 221 | Jev-Style 0.8B v3 | 12.5 | Official leaderboard | ||
| 222 | Tev1-0.8B-experimental | 12.5 | Official leaderboard | ||
| 223 | Bekko System One v0 68M | 12.4 | Official leaderboard | ||
| 224 | LiquidAI d1-omni-600M | 11.8 | Official leaderboard | ||
| 225 | Crivo-17M | 11.7 | Official leaderboard | ||
| 226 | Von 1.3 | 11.7 | Official leaderboard | ||
| 227 | Bosun v3.1 0.6B | 11.0 | Official leaderboard | ||
| 228 | vera-spark | 11.0 | Official leaderboard | ||
| 229 | Lavoir | 10.8 | Official leaderboard | ||
| 230 | GLiNER2.5-Decide | 10.1 | Official leaderboard | ||
| 231 | Laya | 9.2 | Official leaderboard | ||
| 232 | JevK5 Lite | 8.8 | Official leaderboard | ||
| 233 | LFM2.5-2.6B-RLCD | 8.2 | Official leaderboard | ||
| 234 | Qwen-2.5-1B-RLCD | 7.8 | Official leaderboard | ||
| 235 | Bekko System One v0 17M | 7.7 | Official leaderboard | ||
| 236 | CLM-v0.1-8B | 6.5 | Official leaderboard | ||
| 237 | jeff | 6.2 | Official leaderboard | ||
| 238 | LFM2.5-350M-RLCD | 5.9 | Official leaderboard | ||
| 239 | system-one-gemma | 5.2 | Official leaderboard | ||
| 240 | DM-JEPA 1.1 | 5.0 | Official leaderboard | ||
| 241 | Julia 1 | 4.8 | Official leaderboard | ||
| 242 | Nirnaya 0.4B | 3.5 | Official leaderboard | ||
| 243 | Zev | 3.4 | Official leaderboard | ||
| 244 | Verdict | 2.0 | Official leaderboard |
Number one over time
Lab claims count from the day the card came out, independent runs from the model’s release.
Google DeepMind
Scores over time
All the scores we have, one dot each, so a model tested at several settings appears more than once.
On the benchmark’s own leaderboard
No lab model card reports it yet
We read the headline results of 479 launch posts from 51 labs, and none of them list this benchmark.
More in Other
- Personal Superintelligence Index (Meta) In use Meta's composite of seven personal and knowledge-work evals: Agents' Last Exam, AutomationBench-AA, FocusBench, JobBench, GDP.pdf, VBT and DRACO.
- Artificial Analysis Intelligence Index v5 In use Version 5 of Artificial Analysis's index: nine evaluations in four equal categories, most with private test sets, run three times each in its own agent harness. Gemini 4 Carbon 59.0
- Anthropic ECI (AECI) Only in system cards Index that combines a basket of capability benchmarks into one capability score to track trends across Anthropic models. Claude Opus 5.5 169.4
- Qwen in-house English automatic evaluation Only in system cards Models answer Qwen in-house English datasets on knowledge, comprehension, coding, math and related skills. Skills and weights change between reports. Qwen2-72B 72.9%
- Recognition of model-written user turns (Anthropic) Only in system cards Models write synthetic user turns for real Claude Code transcripts, then judge which version is real. Score is accuracy above chance. Claude Mythos Preview 0.35
- LiveBench Dropped Models answer monthly refreshed questions across math, coding, reasoning, language, instruction following, and data analysis. Scored automatically against objective ground truth. Claude Fable 5.1 85.7%