# Decision Index 0.3 Language

> Decision Index 0.3 publishes chance-corrected language scores for 112 evaluated systems.

Canonical page: https://benchlm.ai/benchmarks/jevdecisionindex03language

- Category: [Decision Models](/decision-models)
- Last updated: October 6, 2026

The Decision Index 0.3 board lists 112 evaluated systems. This snapshot follows source commit f03e5a6 and keeps the language score values and size labels published on the board.

The full score weights 37 public benchmarks at 20%, private tests of the same skills at 50%, and private tasks from new domains at 30%. The source reports 110,201 decisions. Scores are chance-corrected and coverage-adjusted; unsupported or unanswered requests count as wrong.

The published aggregates include private task results, but the task contents and item-level answers are not public. We show the board as external reference data, separate from general model rankings.

- [Decision Index 0.3 board](https://huggingface.co/spaces/multimodalart/jev-decision-index)
- [Decision Index methodology](https://huggingface.co/spaces/multimodalart/jev-decision-index/blob/main/methodology.html)
- [Space README and model repositories](https://huggingface.co/spaces/multimodalart/jev-decision-index/blob/main/README.md)
- [Decision Models](/decision-models)

## About Decision Index 0.3 Language

- Year: 2026
- Tasks: Language area of the Decision Index 0.3 evaluation
- Format: Chance-corrected area score
- Difficulty: Language decision tasks
- Paper: [Decision Index 0.3 leaderboard](https://huggingface.co/spaces/multimodalart/jev-decision-index)

The area score appears on the board beside the full score. The full score combines public benchmarks at 20%, private tests of the same skills at 50%, and private tasks from new domains at 30%. Private task contents and item-level results are not published.

Decision Index 0.3 Language is currently displayed on BenchLM for reference, but it is excluded from the weighted scoring formula.

## Leaderboard (112 evaluated systems)

| Rank | Model | Creator | Score |
|------|-------|---------|-------|
| 1 | [Perplexity Decider v1.1 (27B)](/models/decision-index-0-3-perplexity-decider-v1-1-27b) | Perplexity | 62.3 points |
| 2 | [Torchcast Decision 27B](/models/decision-index-0-3-torchcast-decision-27b) | Not listed | 61.5 points |
| 3 | [Quyet-1.0-Large](/models/decision-index-0-3-quyet-1-0-large) | chinhnc | 60.6 points |
| 4 | [Blink v0.3 26B-A4B (NVFP4)](/models/decision-index-0-3-blink-v0-3-26b-a4b-nvfp4) | PixilabAI | 60.5 points |
| 5 | [Surogate Rune 26B-A4B v3](/models/decision-index-rune-26b-a4b-v3) | Surogate | 59.6 points |
| 6 | [Kev 27B](/models/decision-index-0-3-kev-27b) | jaredpalmer | 58.9 points |
| 7 | [Xor 26B-A4B](/models/decision-index-0-3-xor-26b-a4b) | juspay | 58.9 points |
| 8 | [Fastino GLiDE no-thinking (28B)](/models/decision-index-0-3-fastino-glide-no-thinking-28b) | Not listed | 58.7 points |
| 9 | [JPT-35B-A3B](/models/decision-index-0-3-jpt-35b-a3b) | kirp | 58.4 points |
| 10 | [Jev](/models/decision-index-0-3-jev) | Not listed | 58.3 points |
| 11 | [Jebadiah 27B](/models/decision-index-0-3-jebadiah-27b) | frontier-infra | 58.3 points |
| 12 | [deck31b (Gemma 4 31B)](/models/decision-index-0-3-deck31b-gemma-4-31b) | Not listed | 58.2 points |
| 13 | [simple-jev · Qwen3.8-27B (featherless)](/models/decision-index-simple-jev-qwen3-8-27b) | Featherless AI | 57.6 points |
| 14 | [GEV-26B-Decide](/models/decision-index-0-3-gev-26b-decide) | autotrust | 57.4 points |
| 15 | [Decider chat · Gemma-4-31B](/models/decision-index-decider-chat-gemma4-31b) | Mapika | 56.6 points |
| 16 | [JADE](/models/decision-index-0-3-jade) | Not listed | 56.5 points |
| 17 | [Bespoke Nimble 9B v3](/models/decision-index-0-3-bespoke-nimble-9b-v3) | bespokelabs | 56.3 points |
| 18 | [vLLM-SR Decision 2.0 Vega 27B](/models/decision-index-0-3-vllm-sr-decision-2-0-vega-27b) | Not listed | 55.4 points |
| 19 | [AJev lora5 (Gemma 4 12B)](/models/decision-index-0-3-ajev-lora5-gemma-4-12b) | andyzhang232 | 55.0 points |
| 20 | [Solomon v1.1](/models/decision-index-0-3-solomon-v1-1) | Not listed | 54.9 points |
| 21 | [Xor 1.2](/models/decision-index-0-3-xor-1-2) | Not listed | 54.7 points |
| 22 | [Eikos-27B](/models/eikos-27b) | caiovicentino1 | 54.4 points |
| 23 | [JevK5 9B v0.3.3](/models/decision-index-0-3-jevk5-9b-v0-3-3) | alibiserikbay | 54.0 points |
| 24 | [Decider chat · Qwen3.6-27B](/models/decision-index-0-3-decider-chat-qwen3-6-27b) | Not listed | 53.5 points |
| 25 | [JEV-27B](/models/decision-index-0-3-jev-27b) | autotrust | 52.7 points |
| 26 | [reflex 27B](/models/reflex-27b) | kshetrajna12 | 52.6 points |
| 27 | [JoshuaSP diffusiongemma (open-jev)](/models/decision-index-0-3-joshuasp-diffusiongemma-open-jev) | Not listed | 52.6 points |
| 28 | [Winnow-12B](/models/winnow-12b) | Eldan Ring | 52.4 points |
| 29 | [Cloudflare clef](/models/cloudflare-clef) | Cloudflare | 51.6 points |
| 30 | [ezjev 4B s2](/models/decision-index-0-3-ezjev-4b-s2) | everettjf | 50.9 points |
| 31 | [decisio 0.4.0 (Qwen3.6-35B-A3B)](/models/decision-index-0-3-decisio-0-4-0-qwen3-6-35b-a3b) | Not listed | 50.2 points |
| 32 | [Decider 35B-A3B](/models/decider-35b-a3b) | Mapika | 49.7 points |
| 33 | [JPT-9B](/models/decision-index-0-3-jpt-9b) | kirp | 49.7 points |
| 34 | [Jev-Omni](/models/jev-omni) | akhilaaa3 | 49.1 points |
| 35 | [Hopper 12B (trained)](/models/decision-index-0-3-hopper-12b-trained) | Not listed | 49.0 points |
| 36 | [djev](/models/djev) | Maisa | 49.0 points |
| 37 | [jiwo 4B](/models/decision-index-0-3-jiwo-4b) | eljiwo | 48.2 points |
| 38 | [mmastrac diffusiongemma (vLLM PR 57250)](/models/decision-index-0-3-mmastrac-diffusiongemma-vllm-pr-57250) | Not listed | 47.4 points |
| 39 | [Jevfire](/models/decision-index-0-3-jevfire) | Not listed | 47.3 points |
| 40 | [decisio 0.4.0 (Gemma 4 12B)](/models/decision-index-0-3-decisio-0-4-0-gemma-4-12b) | Not listed | 46.4 points |
| 41 | [JevK5 v0.3](/models/decision-index-0-3-jevk5-v0-3) | Not listed | 46.4 points |
| 42 | [vLLM-SR Decision 2.0 Lux 9B](/models/decision-index-0-3-vllm-sr-decision-2-0-lux-9b) | Not listed | 46.3 points |
| 43 | [razorback16 openjev diffusiongemma (NVFP4, vLLM)](/models/decision-index-0-3-razorback16-openjev-diffusiongemma-nvfp4-vllm) | Not listed | 46.0 points |
| 44 | [Sieve 9B](/models/decision-index-0-3-sieve-9b) | sthanika-ai | 45.4 points |
| 45 | [Kev 9B v2](/models/decision-index-0-3-kev-9b-v2) | Not listed | 45.0 points |
| 46 | [JPT-4B](/models/decision-index-0-3-jpt-4b) | kirp | 44.8 points |
| 47 | [Bespoke Nimble 9B v2](/models/decision-index-0-3-bespoke-nimble-9b-v2) | bespokelabs | 44.4 points |
| 48 | [vLLM-SR Decision 2.0 Nox 4B](/models/decision-index-0-3-vllm-sr-decision-2-0-nox-4b) | Not listed | 43.4 points |
| 49 | [RSI-Jev v5.0 VL 3B](/models/decision-index-0-3-rsi-jev-v5-0-vl-3b) | shgao | 43.1 points |
| 50 | [Lev1 3.7B](/models/decision-index-0-3-lev1-3-7b) | Not listed | 42.5 points |
| 51 | [Cloudflare clef-flash](/models/cloudflare-clef-flash) | Cloudflare | 42.4 points |
| 52 | [Intern-Decision-4B](/models/decision-index-0-3-intern-decision-4b) | internlm | 41.9 points |
| 53 | [JEV-9B](/models/decision-index-0-3-jev-9b) | autotrust | 41.7 points |
| 54 | [Hopper (G) 1.2](/models/decision-index-0-3-hopper-g-1-2) | HopitAI | 41.5 points |
| 55 | [Jet v6.2](/models/decision-index-0-3-jet-v6-2) | michaljach | 41.4 points |
| 56 | [Tev1-4B-experimental](/models/decision-index-0-3-tev1-4b-experimental) | togethercomputer | 40.8 points |
| 57 | [Winnow-E4B](/models/decision-index-0-3-winnow-e4b) | EldanRing | 40.2 points |
| 58 | [Metask-Jev-4B](/models/metask-jev-4b) | Wayfind (metask-ai) | 37.8 points |
| 59 | [Kev 4B r10](/models/decision-index-0-3-kev-4b-r10) | jaredpalmer | 37.4 points |
| 60 | [Kas 4B](/models/decision-index-0-3-kas-4b) | kpiya | 36.9 points |
| 61 | [Decider 4B](/models/decision-index-0-3-decider-4b) | Mapika | 36.8 points |
| 62 | [open-jev (pngwn)](/models/decision-index-0-3-open-jev-pngwn) | Not listed | 36.3 points |
| 63 | [Jevstral 8B](/models/decision-index-0-3-jevstral-8b) | AmirBraham | 36.2 points |
| 64 | [NeoHorse-Jev-4B](/models/decision-index-0-3-neohorse-jev-4b) | TokenRhythm | 35.8 points |
| 65 | [Jobe](/models/decision-index-0-3-jobe) | Not listed | 35.7 points |
| 66 | [SemIf](/models/decision-index-0-3-semif) | Not listed | 35.4 points |
| 67 | [Intelif Qwen3-4B](/models/decision-index-0-3-intelif-qwen3-4b) | Not listed | 35.0 points |
| 68 | [Ryotide Qwen v0.3.1](/models/decision-index-0-3-ryotide-qwen-v0-3-1) | Not listed | 34.0 points |
| 69 | [jiwo 0.8B](/models/decision-index-0-3-jiwo-0-8b) | eljiwo | 33.7 points |
| 70 | [lev](/models/decision-index-0-3-lev) | interfaze-ai | 32.3 points |
| 71 | [openvons](/models/decision-index-0-3-openvons) | Not listed | 31.4 points |
| 72 | [Jev-Style 2B v3](/models/decision-index-0-3-jev-style-2b-v3) | Not listed | 29.9 points |
| 73 | [mini-jev](/models/decision-index-0-3-mini-jev) | Not listed | 29.3 points |
| 74 | [Decider 2B](/models/decider-2b) | Mapika | 28.7 points |
| 75 | [Gevva E4B](/models/decision-index-0-3-gevva-e4b) | davidburhans | 28.1 points |
| 76 | [Intern-Decision-2B](/models/decision-index-0-3-intern-decision-2b) | internlm | 26.6 points |
| 77 | [this-that 1.2](/models/decision-index-0-3-this-that-1-2) | Not listed | 25.7 points |
| 78 | [vLLM-SR Decision 2.0 Sol 2B](/models/decision-index-0-3-vllm-sr-decision-2-0-sol-2b) | Not listed | 24.2 points |
| 79 | [EXAONE-4.0-1.2B-JEV v0.3](/models/decision-index-0-3-exaone-4-0-1-2b-jev-v0-3) | Not listed | 23.4 points |
| 80 | [Gevva E2B](/models/decision-index-0-3-gevva-e2b) | davidburhans | 22.3 points |
| 81 | [Sieve 2B](/models/decision-index-0-3-sieve-2b) | sthanika-ai | 21.4 points |
| 82 | [JPT-0.8B](/models/decision-index-0-3-jpt-0-8b) | kirp | 20.9 points |
| 83 | [Bekko System One v0 400M](/models/decision-index-0-3-bekko-system-one-v0-400m) | hotchpotch | 20.9 points |
| 84 | [vLLM-SR Decision 2.0 Eos 0.8B](/models/decision-index-0-3-vllm-sr-decision-2-0-eos-0-8b) | Not listed | 18.4 points |
| 85 | [Sifr 0.8B v3.1](/models/decision-index-0-3-sifr-0-8b-v3-1) | Not listed | 16.9 points |
| 86 | [Dinah-0](/models/decision-index-0-3-dinah-0) | Lukitaduarte | 15.7 points |
| 87 | [OneJev 0.8B](/models/decision-index-0-3-onejev-0-8b) | OmniJev | 15.5 points |
| 88 | [Tev1-0.8B-experimental](/models/decision-index-0-3-tev1-0-8b-experimental) | togethercomputer | 14.6 points |
| 89 | [Bosun v3.1 1.7B](/models/decision-index-0-3-bosun-v3-1-1-7b) | Hanno-Labs | 14.4 points |
| 90 | [Von 1.3](/models/decision-index-0-3-von-1-3) | Not listed | 13.9 points |
| 91 | [GLiNER2.5-Decide](/models/decision-index-0-3-gliner2-5-decide) | fastino | 13.4 points |
| 92 | [Laya](/models/laya) | Convai Innovations | 13.3 points |
| 93 | [Kev 0.8B r15](/models/decision-index-0-3-kev-0-8b-r15) | Not listed | 12.9 points |
| 94 | [vLLM-SR Decision 2.0 Kai 0.6B](/models/decision-index-0-3-vllm-sr-decision-2-0-kai-0-6b) | Not listed | 12.6 points |
| 95 | [JevK5 Lite](/models/decision-index-0-3-jevk5-lite) | alibiserikbay | 12.4 points |
| 96 | [Jev-Style 0.8B v3](/models/decision-index-0-3-jev-style-0-8b-v3) | Not listed | 11.9 points |
| 97 | [Kodiak v0.2 1B (accuracy)](/models/decision-index-0-3-kodiak-v0-2-1b-accuracy) | cortex-agent-llc | 11.9 points |
| 98 | [Lavoir](/models/decision-index-0-3-lavoir) | moganai | 9.9 points |
| 99 | [Intern-Decision-0.8B](/models/decision-index-0-3-intern-decision-0-8b) | internlm | 9.1 points |
| 100 | [jeff](/models/jeff) | Logan Markewich | 8.9 points |
| 101 | [DM-JEPA 1.1](/models/decision-index-0-3-dm-jepa-1-1) | Not listed | 8.1 points |
| 102 | [Qwen-2.5-1B-RLCD](/models/decision-index-0-3-qwen-2-5-1b-rlcd) | harshatheg | 7.0 points |
| 103 | [Bekko System One v0 68M](/models/decision-index-0-3-bekko-system-one-v0-68m) | hotchpotch | 6.5 points |
| 104 | [CLM-v0.1-8B](/models/decision-index-0-3-clm-v0-1-8b) | Contrastive-LM | 5.7 points |
| 105 | [LFM2.5-2.6B-RLCD](/models/decision-index-0-3-lfm2-5-2-6b-rlcd) | monotykamary | 5.6 points |
| 106 | [Bosun v3.1 0.6B](/models/bosun-v31-0-6b) | Clause Logic | 4.9 points |
| 107 | [system-one-gemma](/models/decision-index-0-3-system-one-gemma) | Not listed | 1.6 points |
| 108 | [LFM2.5-350M-RLCD](/models/decision-index-0-3-lfm2-5-350m-rlcd) | notnotsamuel | 1.6 points |
| 109 | [Julia 1](/models/decision-index-0-3-julia-1) | SupersonicLabs | 1.4 points |
| 110 | [Zev](/models/decision-index-0-3-zev) | Not listed | 1.3 points |
| 111 | [Bekko System One v0 17M](/models/decision-index-0-3-bekko-system-one-v0-17m) | hotchpotch | 1.2 points |
| 112 | [Verdict](/models/decision-index-0-3-verdict) | Not listed | 0.4 points |

## FAQ

### What does Decision Index 0.3 Language measure?

Decision Index 0.3 publishes chance-corrected language scores for 112 evaluated systems.

### Which model leads the published Decision Index 0.3 Language snapshot?

Perplexity Decider v1.1 (27B) currently leads the published Decision Index 0.3 Language snapshot with a score of 62.3 points.

### How many models are evaluated on Decision Index 0.3 Language?

The October 6, 2026 contains 112 AI models.

### Does Decision Index 0.3 Language affect BenchLM's overall score?

Not directly. Decision Index 0.3 Language is still displayed on BenchLM for reference, but it is excluded from the weighted scoring formula.
