Capability
Unranked
field median 58.1
Not eligible for a public rank
Five or fewer confirmed AI changes, with original sources, on mornings when something changed.A free source-linked morning brief.
Start free briefReleased Aug 5, 2026 — see all recent releases
Data as of August 14, 2026 · How the score is built
Instruction Following ranks #13. A well-rounded choice across a range of tasks.
27 published rows leave some tracked benchmark slots empty. No comparable first-party API token rate is published.
Each value carries a field reference instead of floating alone. Markers compare this model with the current ranked and priced catalog; they are not absolute quality thresholds.
Capability
Unranked
field median 58.1
Not eligible for a public rank
Price
Self-hosted; infrastructure cost varies
input median $1
No comparable first-party hosted token rate
Speed
Not measured
field median 94 tok/s
Time to first token not measured
Context
262Ktokens
field median 200,000
Maximum output length is tracked separately
Coverage is split by category so a strong number never hides a thin evidence base. Verified means the row is tied to a published source; provisional rows remain visible but separate.
Each documented value carries its source. Missing fields stay visible as not sourced or not published, rather than disappearing from the page.
Self-host and provider-specific paths stay separate from benchmark evidence so operating constraints are visible before a score becomes the whole decision.
Published weights are available, but BenchLM does not yet have a sourced parameter and VRAM profile for this exact model. Hardware cost estimates stay unavailable until that sizing record is complete.
Estimate VRAM from known parametersScores and ranks appear only where published evidence can be displayed. The table keeps the score, weight, cohort, and evidence state together.
| Category | Score | Rank | Percentile | Weight | Benchmarks | Evidence |
|---|---|---|---|---|---|---|
| AgenticRank Not rankedWeight 22%7 benchmarksVerified | 85.1 | Not ranked | Not available | 22% | 7 benchmarks | Verified |
| CodingRank Not rankedWeight 20%5 benchmarksVerified | 47.3 | Not ranked | Not available | 20% | 5 benchmarks | Verified |
| ReasoningWeight 17%0 benchmarksNot measured | Not measured | Not ranked | Not available | 17% | 0 benchmarks | Not measured |
| KnowledgeRank Not rankedWeight 12%4 benchmarksVerified | 47.0 | Not ranked | Not available | 12% | 4 benchmarks | Verified |
| MathWeight 5%0 benchmarksNot measured | Not measured | Not ranked | Not available | 5% | 0 benchmarks | Not measured |
| MultilingualWeight 7%0 benchmarksNot measured | Not measured | Not ranked | Not available | 7% | 0 benchmarks | Not measured |
| MultimodalRank Not rankedWeight 12%10 benchmarksVerified | 79.7 | Not ranked | Not available | 12% | 10 benchmarks | Verified |
| Inst. FollowingRank #13 of 39Percentile 68thWeight 5%1 benchmarkVerified | 90.3 | #13 of 39 | 68th | 5% | 1 benchmark | Verified |
Coding opens by default. The marker compares each value with the best source-verified result in the catalog; provisional leaders do not set the reference. Expand the remaining categories for every published row.
| Benchmark | Score | Versus best verified row | Gap | Weight | Evidence |
|---|---|---|---|---|---|
| SWE-bench Pro | Score61.7% | Versus best verified row Best verified: Claude Mythos 5 · 80.3% | Gap18.6 behind | WeightWeighted 10% | Provider exact |
| Terminal-Bench 2.1Terminal-Bench 2.1 (provider run) | Score73.0% | Versus best verified row Best verified: GLM-5.3 · 88.2% | Gap15.2 behind | WeightDisplay only | Provider exact |
| NL2Repo | Score42.3% | Versus best verified row Best verified: DeepSeek V4 Pro 0813 · 61.5% | Gap19.2 behind | WeightDisplay only | Provider exact |
| deepSwe | Score42.2% | Versus best verified row Best verified: GPT-5.6 Sol · 72.7% | Gap30.5 behind | WeightDisplay only | Provider exact |
| LiveCodeBench v6 | Score90.3% | Versus best verified row Best verified: Sakana Fugu-Ultra · 93.2% | Gap2.9 behind | WeightDisplay only | Provider exact |
| Benchmark | Score | Versus best verified row | Gap | Weight | Evidence |
|---|---|---|---|---|---|
| OSWorld-Verified | Score84.3% | Versus best verified row Best verified: Qwen3.8 Max · 86.1% | Gap1.8 behind | WeightWeighted 34% | Provider exact |
| Terminal-Bench 2.1Terminal-Bench 2.1 (provider run) | Score73.0% | Versus best verified row Best verified: GLM-5.3 · 88.2% | Gap15.2 behind | WeightDisplay only | Provider exact |
| CoWorkBench | Score70.7% | Versus best verified row Best verified: Qwen3.8 Max · 74.8% | Gap4.1 behind | WeightDisplay only | Provider exact |
| JobBench | Score33.4% | Versus best verified row Best verified: Muse Spark 1.1 · 54.7% | Gap21.3 behind | WeightDisplay only | Provider exact |
| Agents' Last Exam | Score42.9% | Versus best verified row Best verified: Qwen3.8 Max · 52.4% | Gap9.5 behind | WeightDisplay only | Provider exact |
| WebArena-VerifiedWebArena-Verified Browser Agent Benchmark | Score64.8% | Versus best verified row Best verified: Muse Spark 1.1 · 69% | Gap4.2 behind | WeightDisplay only | Provider exact |
| AndroidWorld | Score81.9% | Versus best verified row Best verified: Qwen3.8 Max · 85.3% | Gap3.4 behind | WeightDisplay only | Provider exact |
| Benchmark | Score | Versus best verified row | Gap | Weight | Evidence |
|---|---|---|---|---|---|
| HLEHumanity's Last Exam | Score30.8% | Versus best verified row Best verified: Claude Opus 5 · 64.7% | Gap33.9 behind | WeightWeighted 45% | Provider exact |
| GPQAGraduate-Level Google-Proof Q&A | Score89.2% | Versus best verified row Best verified: Sakana Fugu-Ultra · 95.5% | Gap6.3 behind | WeightWeighted 7% | Provider exact |
| GPQA-DGPQA Diamond | Score89.2% | Versus best verified row Best verified: Sakana Fugu-Ultra · 95.5% | Gap6.3 behind | WeightDisplay only | Provider exact |
| HLE w/o toolsHumanity's Last Exam without tools | Score30.8% | Versus best verified row Best verified: Claude Mythos 5 · 59% | Gap28.2 behind | WeightDisplay only | Provider exact |
| Benchmark | Score | Versus best verified row | Gap | Weight | Evidence |
|---|---|---|---|---|---|
| CharXivCharXiv Reasoning | Score90.2% | Versus best verified row Best verified: Claude Mythos 5 · 93.5% | Gap3.3 behind | WeightWeighted 25% | Provider exact |
| MathVision | Score90.0% | Versus best verified row Best verified: Qwen3.8 Max · 95.2% | Gap5.2 behind | WeightDisplay only | Provider exact |
| MathVision w/ PythonMathVision with Python | Score94.6% | Versus best verified row Best verified: Kimi K3 · 97.8% | Gap3.2 behind | WeightDisplay only | Provider exact |
| BabyVision | Score65.7% | Versus best verified row Best verified: Qwen3.8 Max · 82.0% | Gap16.3 behind | WeightDisplay only | Provider exact |
| BabyVision w/ PythonBabyVision with Python | Score85.6% | Versus best verified row Best verified: Qwen3.8 Max · 91.3% | Gap5.7 behind | WeightDisplay only | Provider exact |
| Vision2Web | Score62.9% | Versus best verified row Best verified: Qwen3.8 Max · 69.0% | Gap6.1 behind | WeightDisplay only | Provider exact |
| CharXiv w/o toolsCharXiv Reasoning without tools | Score83.7% | Versus best verified row Best verified: Claude Mythos 5 · 88.9% | Gap5.2 behind | WeightDisplay only | Provider exact |
| OmniDocBench 1.5 | Score91.1% | Versus best verified row Best verified: Qwen3.8 Max · 92.1% | Gap1 behind | WeightDisplay only | Provider exact |
| RealWorldQA | Score85.9% | Versus best verified row Best verified: Qwen3.8 Max · 88.0% | Gap2.1 behind | WeightDisplay only | Provider exact |
| ERQA | Score65.5% | Versus best verified row Best verified: Qwen3.8 Max · 77.8% | Gap12.3 behind | WeightDisplay only | Provider exact |
| Benchmark | Score | Versus best verified row | Gap | Weight | Evidence |
|---|---|---|---|---|---|
| IFBenchInstruction Following Benchmark | Score79.5% | Versus best verified row Best verified: MAI-Thinking-1 · 85% | Gap5.5 behind | WeightWeighted 65% | Provider exact |
The sequence follows explicit supersedes links. Scores and prices remain blank when the corresponding public row or first-party rate is unavailable.
Apr 21, 2026
Qwen3.6-27BScore 53.6 · Price not listed
Aug 5, 2026 · you are here
Qwen3.8-27BNot publicly ranked · Price not listed
Base entry
The visual layer above carries the decisions. These notes preserve the model, ranking, coverage, and family context behind the numbers.
We track Qwen3.8-27B, but the public leaderboard excludes this profile until enough non-generated benchmark coverage is available. Only published rows appear above.
Qwen3.8-27B is a open weight model with a 262K context window. It uses an explicit reasoning mode, which can improve complex problem solving while adding latency and token use.
Qwen publishes the 27B dense checkpoint and a separate FP8 artifact on Hugging Face under Apache-2.0. LM Studio lists a community GGUF package for local use. Qwen Cloud says a hosted qwen3.8-27b service with a default 1M context window and built-in tools is coming soon, so no current first-party API identifier or token rate is stored.
Official exact-value snapshot from Qwen's Qwen3.8-27B model card. We keep Terminal-Bench 2.1 and LiveCodeBench v6 separate from the older weighted lanes, preserve no-Code-Interpreter and Code-Interpreter visual results on separate keys, and leave QwenSWEBench, RecreationBench, ClawEval-MM, and SWE-MM outside the schema instead of forcing them into non-equivalent fields. Qwen reports a dense 27B native vision-language model with a 262,144-token native context window extensible to 1,000,000 tokens.
Its explicit predecessor is Qwen3.6-27B. 27 of 437 tracked benchmark slots currently have displayable evidence. Missing categories stay blank.
Its strongest eligible category is Instruction Following at #13. a well-rounded choice across a range of tasks.
Alibaba · Model release
Qwen3.8-27B has 27 source-displayable benchmark rows, but it does not qualify for a public overall rank. The available rows remain visible by category without being converted into a site-wide score. Missing evidence stays blank instead of being estimated from an earlier model.
Qwen3.8-27B has source-displayable benchmark coverage for knowledge and understanding, but the public category table does not assign it a rank there. The individual rows remain available for inspection. A missing category position means the evidence threshold was not met; it does not convert the model's unmeasured work into a zero.
Qwen3.8-27B has source-displayable benchmark coverage for coding and programming, but the public category table does not assign it a rank there. The individual rows remain available for inspection. A missing category position means the evidence threshold was not met; it does not convert the model's unmeasured work into a zero.
Qwen3.8-27B has source-displayable benchmark coverage for agentic tool use and computer tasks, but the public category table does not assign it a rank there. The individual rows remain available for inspection. A missing category position means the evidence threshold was not met; it does not convert the model's unmeasured work into a zero.
Qwen3.8-27B has source-displayable benchmark coverage for multimodal and grounded tasks, but the public category table does not assign it a rank there. The individual rows remain available for inspection. A missing category position means the evidence threshold was not met; it does not convert the model's unmeasured work into a zero.
Qwen3.8-27B ranks #13 out of 39 eligible models for instruction following, with a public category score of 90.3/100. Higher-ranked alternatives are available for workloads where this category decides the choice. Check the underlying rows before treating the aggregate as a workload guarantee.
Qwen3.8-27B is an open-weight model from Alibaba. Its weights can be downloaded for local or hosted deployment, subject to the published license. Open weight does not automatically mean open source: training data and training code may remain private, and commercial restrictions can still apply.
No. Qwen3.8-27B currently has 27 source-displayable rows across 437 tracked benchmark slots. The profile exposes published, non-generated evidence and leaves missing categories blank until an exact evaluation is available. Coverage describes how much was measured; it is not a penalty added to an individual benchmark result.
Qwen3.8-27B has a documented context window of 262K. That figure is the maximum combined prompt and retained-conversation space reported for this exact model; it is not the maximum output length. The profile keeps output limits separate because providers often publish those limits independently.
Related resources
Last updated August 14, 2026. Runtime fields remain blank until a sourced snapshot exists.
Get one weekly email when material rank, price, availability, or benchmark evidence changes are worth revisiting.
Read a sample issueJoin 2,000+ readers.