Long documents
Prompts that approach the documented context limit
Kimi K2.5
Kimi K2.5 has the larger documented context window.
Updated October 17, 2026. Rank says Qwen3.5 397B is ahead. Price, access, and your workload can each overturn that. Public scores include evidence status and uncertainty.
Qwen3.5 397B has the higher public point estimate, 55.34 versus 53.05. Their conditional score ranges overlap. These ranges do not establish rank confidence. 55 results are shared. Category rows resting on Estimated evidence or different benchmark sets are marked directional and do not name a winner.
Recommendations appear only when a shared evidence basis or an explicit operating constraint supports the call. Secondary and unsupported use cases stay disclosed below the initial list.
Prompts that approach the documented context limit
Kimi K2.5
Kimi K2.5 has the larger documented context window.
1K fresh input + 500 output tokens
Kimi K2.5
Kimi K2.5 has the lower estimated token cost for this stated workload. Costs use the listed standard API rates.
50K fresh input + 3K output tokens
Kimi K2.5
Kimi K2.5 has the lower estimated token cost for this stated workload. Costs use the listed standard API rates.
Code generation, repair, and software-engineering tasks
Not enough matched evidence
Qwen3.5 397B is not ranked on the public lane for coding, so no winner is named for coding.
Tool use, computer use, and multi-step task completion
Not enough matched evidence
Kimi K2.5 and Qwen3.5 397B are scored on Estimated evidence for agentic, so the reading is directional rather than like-for-like.
200K cached + 20K fresh input + 10K output tokens
Not enough matched evidence
The page does not recommend a cost winner because at least one model cannot fit the stated workload in one request. Qwen3.5 397B does not fit this workload in one request. Kimi K2.5 has no published cached-input rate, so cached tokens use its listed input rate. Qwen3.5 397B has no published cached-input rate, so cached tokens use its listed input rate.
Choose a job from the LLM Selector's task catalog to see the category row it rests on, under the same basis rules as the table below. A directional row stays directional; choosing a job never creates a winner.
The same task catalog as the LLM Selector. Each job names the evidence surface it rests on; nothing here adds a new score.
Not comparable · BenchAlign v5.8
The coding row is not comparable on the public lane: at least one model is not measured or not ranked there.
Coding scores combine specific tasks and setups. Match the editor, harness, and effort to your workflow.
Shared results can support a head-to-head reading. Results present for only one model describe coverage, not superiority.
3 categories rest on Estimated evidence or different evidence sets. Those rows remain visible for coverage context but do not name a winner.
Only shared public evidence is shown. Sparse evidence stays a ruled list rather than being closed into a radar shape.
Too few matched category axes support a radar. The ruled list below shows only shared benchmark results; positions use each benchmark’s normalized display scale when available.
BrowseCompAgentic
Normalized gap 8.4SWE MultilingualCoding
Normalized gap 3.7CharXivMultimodal
Normalized gap 3.3AIME26Math
Normalized gap 2.5MMLU-ProXMultilingual
Normalized gap 2.4Each row shows the public-lane category score for both models: the BenchAlign v5.8 lane for agentic, coding, and knowledge, and the weighted public rows elsewhere, with the same rank each model page reports. A row is like-for-like only when both scores rest on Supported evidence or the same weighted set. Directional and not-comparable rows remain visible, but they never receive a winner.
| Category | Kimi K2.5 | Qwen3.5 397B | Basis | Reading |
|---|---|---|---|---|
| Multimodal | 70.4#32/54 | 73.6#29/54 | Like-for-likeProvisional lane · 2 vs 2 weighted rows | Qwen3.5 397B leads |
| Multilingual | 87.3#8/17 | 93.8#5/17 | Like-for-likeProvisional lane · 1 vs 1 weighted rows | Qwen3.5 397B leads |
| Agentic | 40.7Estimated · #66/128 | 43.8Estimated · #61/128 | Directional onlyBenchAlign v5.8 lane · 16 vs 14 public rows | Directional only |
| Knowledge | 51.4Estimated · #75/184 | 53.1Estimated · #68/184 | Directional onlyBenchAlign v5.8 lane · 8 vs 6 public rows | Directional only |
| Instruction following | 85.8#48/148 | 79.9#59/148 | Directional onlyProvisional lane · 0 vs 1 weighted rows | Directional only |
| Coding | 38.5Estimated · #68/150 | Not ranked | Not comparableBenchAlign v5.8 lane · 10 vs 6 public rows | Not comparable |
| Reasoning | 72.2Unranked · 3 rankable rows | 74.9Unranked · 2 rankable rows | Not comparableProvisional lane · 1 vs 1 weighted rows | Not comparable |
| Math | 83.3Unranked · 7 rankable rows | 81.7Unranked · 5 rankable rows | Not comparableProvisional lane · 2 vs 2 weighted rows | Not comparable |
Ranks count the models scored in each category’s lane, so the agentic, coding, and knowledge denominators (BenchAlign v5.8) differ from the provisional-lane categories. Unranked scores sit on the provisional lane’s scale but never name a winner. Like-for-like rows within 0.5 points read as a practical tie.
Three fixed token mixes turn per-token rates into comparable decisions. Each scenario states context fit and whether cached input had to fall back to the published list-input rate.
1K fresh input + 500 output tokens
Kimi K2.5 has the lower modeled cost
Costs use the listed standard API rates.
50K fresh input + 3K output tokens
Kimi K2.5 has the lower modeled cost
Costs use the listed standard API rates.
200K cached + 20K fresh input + 10K output tokens
Qwen3.5 397B does not fit this workload in one request. Kimi K2.5 has no published cached-input rate, so cached tokens use its listed input rate. Qwen3.5 397B has no published cached-input rate, so cached tokens use its listed input rate.
Sourced differences are shown directly. Missing facts stay explicit instead of being inferred from a model name or family.
Maximum documented context; output-token limits may be lower.
Kimi K2.5
256K
Qwen3.5 397B
128K
Kimi K2.5
Not sourced
Qwen3.5 397B
Not sourced
A missing cached-input rate falls back to the listed input rate only in the stated workload estimate.
Kimi K2.5
Not published
Qwen3.5 397B
Not published
Kimi K2.5
Not sourced
Qwen3.5 397B
Not sourced
Kimi K2.5
Not sourced
Qwen3.5 397B
Not sourced
Kimi K2.5
Not sourced
Qwen3.5 397B
Not sourced
Kimi K2.5
Non-Reasoning
Qwen3.5 397B
Non-Reasoning
Kimi K2.5
Open Weight
Qwen3.5 397B
Open Weight
Kimi K2.5
Open Weight
Qwen3.5 397B
Open Weight
Kimi K2.5
2026-01-27
Qwen3.5 397B
2026-02-16
Qwen3.5 397B has the higher public point estimate, 55.34 versus 53.05. Their conditional score ranges overlap. These ranges do not establish rank confidence. The page therefore keeps the decision tied to the specific documented workload.
Qwen3.5 397B is not ranked on the public lane for coding, so no winner is named for coding.
Qwen3.5 397B scores higher for agentic tasks on the public lane, 43.8 to 40.7. Kimi K2.5 and Qwen3.5 397B are scored on Estimated evidence for agentic tasks, so the reading is directional rather than like-for-like. BenchLM does not name a winner for agentic tasks from a directional reading; read the shared benchmark rows directly and test the models on the same task set.
For the stated presets, chat costs $0.0021 on Kimi K2.5 and $0.0024 on Qwen3.5 397B; repository review costs $0.039 and $0.0408; the cache-heavy agent loop costs $0.162 and $0.168. Qwen3.5 397B does not fit this workload in one request. Kimi K2.5 has no published cached-input rate, so cached tokens use its listed input rate. Qwen3.5 397B has no published cached-input rate, so cached tokens use its listed input rate.
Kimi K2.5 has the larger documented context window: 256K, compared with 128K.
Estimates at 50,000 req/day · 1000 tokens/req average.
The full public result ledger is available for audit without forcing a wide desktop table onto a phone.
Terminal-Bench 2.0
Qwen3.5 397B leads this result
BrowseComp
Qwen3.5 397B leads this result
OSWorld-Verified
Kimi K2.5 leads this result
Claw-Eval
Shared sourceQwen3.5 397B leads this result
QwenClawBench
Shared sourceKimi K2.5 leads this result
τ³-bench results
Shared sourceQwen3.5 397B leads this result
DeepSearchQA
Not directly comparable
DeepPlanning
Shared sourceQwen3.5 397B leads this result
Toolathlon
Qwen3.5 397B leads this result
MCP Atlas
Qwen3.5 397B leads this result
MCP-Tasks
Shared sourceQwen3.5 397B leads this result
WideResearch
Qwen3.5 397B leads this result
BFCL v4
Not directly comparable
Gert Labs
Shared sourceQwen3.5 397B leads this result
ResearchClawBench
Shared sourceQwen3.5 397B leads this result
JobBench
Not directly comparable
VITA-Bench
Not directly comparable
SWE-bench Verified
Kimi K2.5 leads this result
SWE-bench Verified*
Not directly comparable
LiveCodeBench v6
Kimi K2.5 leads this result
SWE-bench Pro
Qwen3.5 397B leads this result
SWE Multilingual
Kimi K2.5 leads this result
SWE-Rebench
Not directly comparable
React Native Evals
Not directly comparable
NL2Repo
Qwen3.5 397B leads this result
SciCode
Not directly comparable
Terminal-Bench 2.0
Qwen3.5 397B leads this result
MMMU
Shared sourceQwen3.5 397B leads this result
MMMU-Pro
Qwen3.5 397B leads this result
RealWorldQA
Shared sourceQwen3.5 397B leads this result
OmniDocBench 1.5
Qwen3.5 397B leads this result
Video-MME
Not directly comparable
Video-MME (with subtitle)
Shared sourceQwen3.5 397B leads this result
Video-MME (w/o subtitle)
Shared sourceQwen3.5 397B leads this result
MathVision
Qwen3.5 397B leads this result
We-Math
Shared sourceQwen3.5 397B leads this result
DynaMath
Shared sourceQwen3.5 397B leads this result
SimpleVQA
Kimi K2.5 leads this result
MMLongBench-Doc
Shared sourceQwen3.5 397B leads this result
CC-OCR
Shared sourceQwen3.5 397B leads this result
AI2D_TEST
Shared sourceQwen3.5 397B leads this result
CountBench
Shared sourceQwen3.5 397B leads this result
RefCOCO (avg)
Shared sourceQwen3.5 397B leads this result
MMVU
Not directly comparable
VideoMMMU
Shared sourceKimi K2.5 leads this result
MLVU (M-Avg)
Shared sourceQwen3.5 397B leads this result
CharXiv
Qwen3.5 397B leads this result
ODINW13
Not directly comparable
ERQA
Not directly comparable
ScreenSpot Pro
Not directly comparable
V*
Not directly comparable
GPQA
Qwen3.5 397B leads this result
GPQA-D
Not directly comparable
SuperGPQA
Shared sourceQwen3.5 397B leads this result
MMLU-Pro
Qwen3.5 397B leads this result
MMLU-Pro (Arcee)
Not directly comparable
MMLU-Redux
Qwen3.5 397B leads this result
C-Eval
Kimi K2.5 leads this result
HLE
Kimi K2.5 leads this result
MMLU-ProX
Shared sourceQwen3.5 397B leads this result
NOVA-63
Shared sourceQwen3.5 397B leads this result
INCLUDE
Shared sourceQwen3.5 397B leads this result
PolyMath
Shared sourceQwen3.5 397B leads this result
MAXIFE
Shared sourceQwen3.5 397B leads this result
IFEval
Shared sourceKimi K2.5 leads this result
IFBench
Not directly comparable
AIME 2025
Not directly comparable
AIME26
Kimi K2.5 leads this result
AIME25 (Arcee)
Not directly comparable
HMMT Feb 2025
Kimi K2.5 leads this result
HMMT Nov 2025
Qwen3.5 397B leads this result
HMMT Feb 2026
Qwen3.5 397B leads this result
MMAnswerBench
Kimi K2.5 leads this result
One weekly email when material rank, price, or benchmark evidence changes make this matchup worth revisiting.
Read a sample issueJoin 5,600+ readers.
Last updated October 17, 2026