Decision Index 0.3 Language

We show this table for reference; we do not rank on it.

Data verified October 6, 2026

Decision Index 0.3 publishes chance-corrected language scores for 112 evaluated systems.

Language score on Decision Index 0.3 Language — October 6, 2026

We mirror the published language score view for Decision Index 0.3 Language. The public snapshot contains 112 evaluated systems. Perplexity Decider v1.1 (27B) has the highest published score at 62.3 points, but the available coverage and evaluation setups do not establish a market leader. We do not use these results to rank models overall.

1Open weights

Perplexity Decider v1.1 (27B)

Perplexity

62.3 points

2Evaluated configuration

Torchcast Decision 27B

Not listed

61.5 points

3Open weights

Quyet-1.0-Large

chinhnc

60.6 points

112 evaluated systemsDecision ModelsCurrentDisplay onlyUpdated October 6, 2026

Language score table (112 evaluated systems)

Showing 112 of 112

Language score table with model size, weight access, and scores
Rank	Model / configuration	Reported size	Weights	Score
1	Perplexity Decider v1.1 (27B)PerplexityModel sourceAnswered 100% · Latency 0.1s	28B	Open	62.3 points
2	Torchcast Decision 27BNot listedAnswered 100% · Latency 0.1s	28B	Evaluated configuration	61.5 points
3	Quyet-1.0-LargechinhncModel sourceAnswered 91.5% · Latency 0.1s	33B	Open	60.6 points
4	Blink v0.3 26B-A4B (NVFP4)PixilabAIModel sourceAnswered 100% · Latency 0.0s	26B	Open	60.5 points
5	Surogate Rune 26B-A4B v3SurogateModel sourceCalibration 12 · Answered 99.6% · Latency 0.1s	26B	Open	59.6 points
6	Kev 27BjaredpalmerModel sourceCalibration 2.2 · Answered 100% · Latency 0.1s	28B	Open	58.9 points
7	Xor 26B-A4BjuspayModel sourceAnswered 100% · Latency 0.1s	26B	Open	58.9 points
8	Fastino GLiDE no-thinking (28B)Not listedCalibration 4 · Answered 100% · Latency 0.1s	28B	Evaluated configuration	58.7 points
9	JPT-35B-A3BkirpModel sourceAnswered 91.5% · Latency 0.3s	~36B	Open	58.4 points
10	JevNot listedCalibration 7.4 · Answered 100% · Latency 0.5s	Not disclosed	Evaluated configuration	58.3 points
11	Jebadiah 27Bfrontier-infraModel sourceCalibration 1.4 · Answered 100% · Latency 0.1s	28B	Open	58.3 points
12	deck31b (Gemma 4 31B)Not listedAnswered 91.5% · Latency 0.2s	33B	Evaluated configuration	58.2 points
13	simple-jev · Qwen3.8-27B (featherless)Featherless AIModel sourceCalibration 11.3 · Answered 99.6% · Latency 0.4s	28B	Evaluated configuration	57.6 points
14	GEV-26B-DecideautotrustModel sourceAnswered 100% · Latency 0.1s	26B	Open	57.4 points
15	Decider chat · Gemma-4-31BMapikaModel sourceCalibration 4.7 · Answered 99.6% · Latency 0.1s	33B	Evaluated configuration	56.6 points
16	JADENot listedAnswered 100% · Latency 0.1s	28B	Evaluated configuration	56.5 points
17	Bespoke Nimble 9B v3bespokelabsModel sourceAnswered 100% · Latency 0.1s	9.7B	Open	56.3 points
18	vLLM-SR Decision 2.0 Vega 27BNot listedAnswered 100% · Latency 0.1s	28B	Evaluated configuration	55.4 points
19	AJev lora5 (Gemma 4 12B)andyzhang232Model sourceAnswered 100% · Latency 0.3s	12B	Open	55.0 points
20	Solomon v1.1Not listedCalibration 8.1 · Answered 75% · Latency 0.2s	28B	Evaluated configuration	54.9 points
21	Xor 1.2Not listedAnswered 100% · Latency 0.1s	36B	Evaluated configuration	54.7 points
22	Eikos-27Bcaiovicentino1Model sourceCalibration 5.7 · Answered 100% · Latency 0.1s	28B	Not listed	54.4 points
23	JevK5 9B v0.3.3alibiserikbayModel sourceAnswered 100% · Latency 0.0s	9.7B	Open	54.0 points
24	Decider chat · Qwen3.6-27BNot listedCalibration 2.1 · Answered 99.6% · Latency 0.1s	28B	Evaluated configuration	53.5 points
25	JEV-27BautotrustModel sourceAnswered 100% · Latency 0.1s	28B	Open	52.7 points
26	reflex 27Bkshetrajna12Calibration 2.4 · Answered 100% · Latency 0.1s	28B	Open	52.6 points
27	JoshuaSP diffusiongemma (open-jev)Not listedCalibration 21.6 · Answered 99.7% · Latency 0.3s	26B	Evaluated configuration	52.6 points
28	Winnow-12BEldan RingModel sourceCalibration 16.8 · Answered 100% · Latency 0.1s	12B	Open	52.4 points
29	Cloudflare clefCloudflareModel sourceCalibration 4 · Answered 100% · Latency 0.1s	28B	Open	51.6 points
30	ezjev 4B s2everettjfModel sourceAnswered 100% · Latency 0.0s	4.7B	Open	50.9 points
31	decisio 0.4.0 (Qwen3.6-35B-A3B)Not listedAnswered 100% · Latency 0.1s	36B	Evaluated configuration	50.2 points
32	Decider 35B-A3BMapikaModel sourceCalibration 2.3 · Answered 100% · Latency 0.1s	36B	Open	49.7 points
33	JPT-9BkirpModel sourceCalibration 7.7 · Answered 100% · Latency 0.1s	9.7B	Open	49.7 points
34	Jev-Omniakhilaaa3Model sourceCalibration 16.1 · Answered 99.6% · Latency 0.1s	12B	Open	49.1 points
35	Hopper 12B (trained)Not listedAnswered 91.5% · Latency 0.3s	12B	Evaluated configuration	49.0 points
36	djevMaisaCalibration 21.2 · Answered 98.9% · Latency 0.1s	26B	Open	49.0 points
37	jiwo 4BeljiwoModel sourceAnswered 100% · Latency 0.1s	4.7B	Open	48.2 points
38	mmastrac diffusiongemma (vLLM PR 57250)Not listedCalibration 20.2 · Answered 86.8% · Latency 0.1s	26B	Evaluated configuration	47.4 points
39	JevfireNot listedCalibration 5.2 · Answered 100% · Latency 0.1s	28B	Evaluated configuration	47.3 points
40	decisio 0.4.0 (Gemma 4 12B)Not listedAnswered 100% · Latency 0.0s	12B	Evaluated configuration	46.4 points
41	JevK5 v0.3Not listedAnswered 100% · Latency 0.0s	4.7B	Evaluated configuration	46.4 points
42	vLLM-SR Decision 2.0 Lux 9BNot listedAnswered 100% · Latency 0.0s	9.7B	Evaluated configuration	46.3 points
43	razorback16 openjev diffusiongemma (NVFP4, vLLM)Not listedCalibration 23.2 · Answered 99.6% · Latency 0.0s	26B	Evaluated configuration	46.0 points
44	Sieve 9Bsthanika-aiModel sourceAnswered 100% · Latency 0.1s	9.7B	Open	45.4 points
45	Kev 9B v2Not listedCalibration 4.5 · Answered 100% · Latency 0.1s	9.7B	Evaluated configuration	45.0 points
46	JPT-4BkirpModel sourceCalibration 7.9 · Answered 100% · Latency 0.1s	4.7B	Open	44.8 points
47	Bespoke Nimble 9B v2bespokelabsModel sourceCalibration 2.4 · Answered 99.6% · Latency 0.1s	9.7B	Open	44.4 points
48	vLLM-SR Decision 2.0 Nox 4BNot listedAnswered 100% · Latency 0.0s	4.2B	Evaluated configuration	43.4 points
49	RSI-Jev v5.0 VL 3BshgaoModel sourceAnswered 100% · Latency 0.0s	4.7B	Open	43.1 points
50	Lev1 3.7BNot listedAnswered 100% · Latency 0.0s	~3.7B	Evaluated configuration	42.5 points
51	Cloudflare clef-flashCloudflareModel sourceCalibration 2.5 · Answered 100% · Latency 0.1s	9.7B	Open	42.4 points
52	Intern-Decision-4BinternlmModel sourceCalibration 2.8 · Answered 99.6% · Latency 0.0s	4.7B	Open	41.9 points
53	JEV-9BautotrustModel sourceAnswered 100% · Latency 0.1s	9.7B	Open	41.7 points
54	Hopper (G) 1.2HopitAIModel sourceCalibration 9.3 · Answered 99.6% · Latency 0.0s	4.7B	Open	41.5 points
55	Jet v6.2michaljachModel sourceCalibration 14.1 · Answered 99.8% · Latency 0.0s	4.7B	Open	41.4 points
56	Tev1-4B-experimentaltogethercomputerModel sourceCalibration 10.4 · Answered 86.2% · Latency 0.0s	4.7B	Open	40.8 points
57	Winnow-E4BEldanRingModel sourceCalibration 5.8 · Answered 99.6% · Latency 0.0s	8.0B	Open	40.2 points
58	Metask-Jev-4BWayfind (metask-ai)Model sourceCalibration 10.3 · Answered 86.8% · Latency 0.1s	4.7B	Open	37.8 points
59	Kev 4B r10jaredpalmerModel sourceCalibration 3.2 · Answered 100% · Latency 0.1s	4.7B	Open	37.4 points
60	Kas 4BkpiyaModel sourceAnswered 91.5% · Latency 0.1s	4.0B	Open	36.9 points
61	Decider 4BMapikaModel sourceCalibration 8.4 · Answered 99.6% · Latency 0.0s	4.7B	Open	36.8 points
62	open-jev (pngwn)Not listedCalibration 5.9 · Answered 99.8% · Latency 0.1s	4.7B	Evaluated configuration	36.3 points
63	Jevstral 8BAmirBrahamModel sourceAnswered 100% · Latency 0.0s	~8.0B	Open	36.2 points
64	NeoHorse-Jev-4BTokenRhythmModel sourceCalibration 10.4 · Answered 99.6% · Latency 0.0s	4.7B	Open	35.8 points
65	JobeNot listedCalibration 12.3 · Answered 100% · Latency 0.1s	4.7B	Evaluated configuration	35.7 points
66	SemIfNot listedCalibration 9.9 · Answered 86.1% · Latency 0.1s	4.7B	Evaluated configuration	35.4 points
67	Intelif Qwen3-4BNot listedAnswered 100% · Latency 0.0s	4.0B	Evaluated configuration	35.0 points
68	Ryotide Qwen v0.3.1Not listedAnswered 100% · Latency 0.1s	4.0B	Evaluated configuration	34.0 points
69	jiwo 0.8BeljiwoModel sourceAnswered 100% · Latency 0.0s	870M	Open	33.7 points
70	levinterfaze-aiModel sourceCalibration 6.4 · Answered 99.6% · Latency 0.1s	4.7B	Open	32.3 points
71	openvonsNot listedCalibration 37.1 · Answered 100% · Latency 0.0s	4.0B	Evaluated configuration	31.4 points
72	Jev-Style 2B v3Not listedAnswered 100% · Latency 0.1s	2.3B	Evaluated configuration	29.9 points
73	mini-jevNot listedCalibration 34.6 · Answered 86.8% · Latency 0.1s	4.0B	Evaluated configuration	29.3 points
74	Decider 2BMapikaModel sourceCalibration 7.7 · Answered 100% · Latency 0.0s	2.3B	Open	28.7 points
75	Gevva E4BdavidburhansModel sourceAnswered 100% · Latency 0.1s	8.0B	Open	28.1 points
76	Intern-Decision-2BinternlmModel sourceCalibration 6.1 · Answered 99.6% · Latency 0.0s	2.3B	Open	26.6 points
77	this-that 1.2Not listedCalibration 19.8 · Answered 99.6% · Latency 0.0s	1.9B	Evaluated configuration	25.7 points
78	vLLM-SR Decision 2.0 Sol 2BNot listedAnswered 100% · Latency 0.0s	2.3B	Evaluated configuration	24.2 points
79	EXAONE-4.0-1.2B-JEV v0.3Not listedAnswered 100% · Latency 0.1s	~1.3B	Evaluated configuration	23.4 points
80	Gevva E2BdavidburhansModel sourceAnswered 100% · Latency 0.0s	5.1B	Open	22.3 points
81	Sieve 2Bsthanika-aiModel sourceAnswered 100% · Latency 0.1s	2.3B	Open	21.4 points
82	JPT-0.8BkirpModel sourceCalibration 6.9 · Answered 100% · Latency 0.1s	873M	Open	20.9 points
83	Bekko System One v0 400MhotchpotchModel sourceAnswered 100% · Latency 0.0s	~400M	Open	20.9 points
84	vLLM-SR Decision 2.0 Eos 0.8BNot listedAnswered 100% · Latency 0.0s	870M	Evaluated configuration	18.4 points
85	Sifr 0.8B v3.1Not listedAnswered 100% · Latency 0.0s	870M	Evaluated configuration	16.9 points
86	Dinah-0LukitaduarteModel sourceAnswered 100% · Latency 0.0s	150M	Open	15.7 points
87	OneJev 0.8BOmniJevModel sourceAnswered 100% · Latency 0.1s	870M	Open	15.5 points
88	Tev1-0.8B-experimentaltogethercomputerModel sourceCalibration 12.6 · Answered 86.2% · Latency 0.0s	873M	Open	14.6 points
89	Bosun v3.1 1.7BHanno-LabsModel sourceCalibration 13 · Answered 99.6% · Latency 0.0s	1.7B	Open	14.4 points
90	Von 1.3Not listedAnswered 100% · Latency 0.0s	400M	Evaluated configuration	13.9 points
91	GLiNER2.5-DecidefastinoModel sourceCalibration 8.8 · Answered 99.6% · Latency 0.0s	486M	Open	13.4 points
92	LayaConvai InnovationsModel sourceCalibration 14 · Answered 99.6% · Latency 0.0s	421M	Open	13.3 points
93	Kev 0.8B r15Not listedCalibration 4 · Answered 100% · Latency 0.0s	870M	Evaluated configuration	12.9 points
94	vLLM-SR Decision 2.0 Kai 0.6BNot listedAnswered 100% · Latency 0.0s	600M	Evaluated configuration	12.6 points
95	JevK5 LitealibiserikbayModel sourceAnswered 69% · Latency 0.0s	300M	Open	12.4 points
96	Jev-Style 0.8B v3Not listedAnswered 99.9% · Latency 0.0s	870M	Evaluated configuration	11.9 points
97	Kodiak v0.2 1B (accuracy)cortex-agent-llcModel sourceAnswered 99.9% · Latency 0.1s	3.0B	Open	11.9 points
98	LavoirmoganaiModel sourceCalibration 14.9 · Answered 99.7% · Latency 0.0s	396M	Open	9.9 points
99	Intern-Decision-0.8BinternlmModel sourceCalibration 2.5 · Answered 99.6% · Latency 0.0s	873M	Open	9.1 points
100	jeffLogan MarkewichCalibration 9.7 · Answered 100% · Latency 0.0s	~576M	Open	8.9 points
101	DM-JEPA 1.1Not listedAnswered 91.5% · Latency 0.1s	149M	Evaluated configuration	8.1 points
102	Qwen-2.5-1B-RLCDharshathegModel sourceCalibration 20.5 · Answered 99.7% · Latency 0.0s	1.5B	Open	7.0 points
103	Bekko System One v0 68MhotchpotchModel sourceAnswered 100% · Latency 0.0s	~68M	Open	6.5 points
104	CLM-v0.1-8BContrastive-LMModel sourceCalibration 32.3 · Answered 99.6% · Latency 0.0s	8.2B	Open	5.7 points
105	LFM2.5-2.6B-RLCDmonotykamaryModel sourceCalibration 25.4 · Answered 99.5% · Latency 0.0s	2.7B	Open	5.6 points
106	Bosun v3.1 0.6BClause LogicModel sourceCalibration 14.2 · Answered 99.6% · Latency 0.0s	596M	Open	4.9 points
107	system-one-gemmaNot listedCalibration 23.9 · Answered 99.9% · Latency 0.0s	268M	Evaluated configuration	1.6 points
108	LFM2.5-350M-RLCDnotnotsamuelModel sourceCalibration 56.8 · Answered 100% · Latency 0.0s	354M	Open	1.6 points
109	Julia 1SupersonicLabsModel sourceCalibration 42 · Answered 99.6% · Latency 0.0s	~141M	Open	1.4 points
110	ZevNot listedAnswered 100% · Latency 0.0s	Not disclosed	Evaluated configuration	1.3 points
111	Bekko System One v0 17MhotchpotchModel sourceAnswered 100% · Latency 0.0s	~17M	Open	1.2 points
112	VerdictNot listedCalibration 15.4 · Answered 40.2% · Latency 0.0s	151M	Evaluated configuration	0.4 points

How to read this leaderboard

The source uses a 0 to 100 scale, with 0 at chance and 100 at perfect performance. Scores are coverage-adjusted; an unanswered or unsupported request counts as wrong.

Operator receipt: 112 sourced rows are currently displayable on this page; the highest published score among these 112 evaluated systems is Perplexity Decider v1.1 (27B) at 62.3 points, which does not establish a market leader.

Honest limit: This is an area score from a composite that includes private tasks. It is display-only and does not enter general model rankings.

Decision Models

Decision Index 0.3 leaderboard Decision Index methodology

How we show Decision Index 0.3

The Decision Index 0.3 board lists 112 evaluated systems. This snapshot follows source commit f03e5a6 and keeps the language score values and size labels published on the board.

The full score weights 37 public benchmarks at 20%, private tests of the same skills at 50%, and private tasks from new domains at 30%. The source reports 110,201 decisions. Scores are chance-corrected and coverage-adjusted; unsupported or unanswered requests count as wrong.

The published aggregates include private task results, but the task contents and item-level answers are not public. We show the board as external reference data, separate from general model rankings.

Snapshot

112 systems37 public benchmarks110,201 decisions20% public · 80% privateDisplay only

Decision Index 0.3 board Decision Index methodology Space README and model repositories Decision Models

The published Decision Index 0.3 Language snapshot places Perplexity Decider v1.1 (27B) first at 62.3 points. The third row is 1.7 points behind. The broader top-10 range is 4.0 points, so many of the published results sit in a relatively narrow band.

112 evaluated systems are shown for Decision Index 0.3 Language. The benchmark falls in the Decision Models category. We keep external benchmark mirrors separate from the weighted global scoring system, so these results remain source-specific evidence. Decision Index 0.3 Language is currently displayed for reference but excluded from the scoring formula, so it does not directly affect overall rankings.

About Decision Index 0.3 Language

Year

2026

Tasks

Language area of the Decision Index 0.3 evaluation

Format

Chance-corrected area score

Difficulty

Language decision tasks

The area score appears on the board beside the full score. The full score combines public benchmarks at 20%, private tests of the same skills at 50%, and private tasks from new domains at 30%. Private task contents and item-level results are not published.

Decision Index 0.3 leaderboard Public benchmark source

Freshness and provenance

Version

Decision Index 0.3

Refresh cadence

Pinned benchmark-owner snapshot

Staleness state

Current

Question availability

37 public benchmarks; same-skill and new-domain task contents and item-level results are private

CurrentDisplay only

BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.

Questions

What does Decision Index 0.3 Language measure?

Decision Index 0.3 publishes chance-corrected language scores for 112 evaluated systems.

Which model leads the published Decision Index 0.3 Language snapshot?

Perplexity Decider v1.1 (27B) currently leads the published Decision Index 0.3 Language snapshot with 62.3 points language score. BenchLM shows this benchmark for display only and does not use it in overall rankings.

How many models are evaluated on Decision Index 0.3 Language?

The October 6, 2026 snapshot contains 112 AI models.

Last updated: October 6, 2026 · mirrored from the public benchmark leaderboard

Know when it’s worth switching models

The model to choose, the cheaper alternative, and the release we would wait on.

Read a sample issue

Join 5,600+ readers.

One email each week. Unsubscribe anytime.