Model profile
Qwen3.5 397B
Evidence coverage
55 of 321 tracked benchmarks are published. 38 are verified and 17 provisional. 8 of 8 categories are measured.
- Published / tracked
- 55 / 321
- Verified
- 38
- Provisional
- 17
- Categories with evidence
- 8 / 8
Evidence by category
- Agentic18 benchmarksMixed evidence
- Coding5 benchmarksMixed evidence
- Reasoning4 benchmarksMixed evidence
- Knowledge12 benchmarksMixed evidence
- Math5 benchmarksVerified
- Multilingual2 benchmarksVerified
- Multimodal7 benchmarksMixed evidence
- Inst. Following2 benchmarksMixed evidence
Qwen3.5 397B ranks #71 out of 200 models on the public leaderboard with an overall score of 57.01/100. It does not yet have enough sourced coverage for BenchLM's verified leaderboard. While not a frontier model, it offers specific advantages depending on the use case.
Qwen3.5 397B is a open weight model with a 128K token context window. It processes queries without explicit chain-of-thought reasoning, offering faster response times and lower token usage.
Qwen3.5 397B sits inside the Qwen3.5 397B family alongside Qwen3.5 397B (Reasoning). This profile currently has 55 of 321 tracked benchmarks. BenchLM only exposes non-generated benchmark rows publicly, so missing categories stay blank until a sourced evaluation is available.
Its strongest category is Multilingual (#5), while its weakest is Agentic (#67). This performance profile makes it a well-rounded choice across a range of tasks.
Peer position
Exact provisional scores and ranks for the closest listed peers. A score can appear before a model clears the evidence threshold for a rank, so equal scores can have different rank states.
Range 56.59–57.25
- Gemini 2.5 ProGoogleCompare#7057.25Gemini 2.5 Pro is #70 with a score of 57.25.
- Qwen3.5 397BCurrent modelAlibaba#7157.01Qwen3.5 397B is #71 with a score of 57.01.
- Qwen3.5-35B-A3BAlibabaCompare#7256.97Qwen3.5-35B-A3B is #72 with a score of 56.97.
- GPT-5.3-Codex-SparkOpenAICompare#7356.91GPT-5.3-Codex-Spark is #73 with a score of 56.91.
- Kimi K2.6Moonshot AICompare#7456.79Kimi K2.6 is #74 with a score of 56.79.
- GPT-5.4 miniOpenAICompare#7556.77GPT-5.4 mini is #75 with a score of 56.77.
- Grok 4 Fast (Reasoning)xAICompare#7656.59Grok 4 Fast (Reasoning) is #76 with a score of 56.59.
Category percentile
More
Relative position among models eligible for each sourced category. A higher percentile means a stronger position within that category's ranked cohort; 100 is highest.
- Multilingual67%Eligible cohort rank #5 of 13Category score 69.7
- Inst. Following65%Eligible cohort rank #14 of 38Category score 86.5
- Multimodal43%Eligible cohort rank #17 of 29Category score 66.4
- Knowledge20%Eligible cohort rank #42 of 52Category score 57.5
- Coding62%Eligible cohort rank #47 of 122Category score 52.9
- Agentic44%Eligible cohort rank #67 of 119Category score 46.1
Category evidence
Scores and ranks appear only where this model has published benchmark evidence. Categories without displayable source records remain not measured.
| Category | Score | Rank | Percentile | Weight | Benchmarks | Evidence |
|---|---|---|---|---|---|---|
| AgenticRank #67 of 119Percentile 44thWeight 22%18 benchmarksMixed sources | 46.1 | #67 of 119 | 44th | 22% | 18 benchmarks | Mixed sources |
| CodingRank #47 of 122Percentile 62ndWeight 20%5 benchmarksMixed sources | 52.9 | #47 of 122 | 62nd | 20% | 5 benchmarks | Mixed sources |
| ReasoningRank Not rankedWeight 17%4 benchmarksMixed sources | 87.3 | Not ranked | Not available | 17% | 4 benchmarks | Mixed sources |
| KnowledgeRank #42 of 52Percentile 20thWeight 12%12 benchmarksMixed sources | 57.5 | #42 of 52 | 20th | 12% | 12 benchmarks | Mixed sources |
| MathRank Not rankedWeight 5%5 benchmarksVerified | 74.7 | Not ranked | Not available | 5% | 5 benchmarks | Verified |
| MultilingualRank #5 of 13Percentile 67thWeight 7%2 benchmarksVerified | 69.7 | #5 of 13 | 67th | 7% | 2 benchmarks | Verified |
| MultimodalRank #17 of 29Percentile 43rdWeight 12%7 benchmarksMixed sources | 66.4 | #17 of 29 | 43rd | 12% | 7 benchmarks | Mixed sources |
| Inst. FollowingRank #14 of 38Percentile 65thWeight 5%2 benchmarksMixed sources | 86.5 | #14 of 38 | 65th | 5% | 2 benchmarks | Mixed sources |
Chatbot Arena performance
Scroll horizontally to inspect confidence intervals and vote counts.
| View | Elo | Confidence interval | Votes |
|---|---|---|---|
| Text Overall | 1400 | Not available | Not available |
Benchmark Details
Rows below have a displayable published verification record. Each source link and provenance note remains in the page HTML while its category is closed. Source-unverified manual rows and generated rows stay hidden.
Agentic18 benchmarks
τ³-Bench Tool-Agent-User Evaluation
τ²-Bench Tool-Agent-User Evaluation
Gert Labs Composite Game Benchmark
Artificial Analysis Agentic Index
GDPval-AA normalized
Coding5 benchmarks
Software Engineering Benchmark Verified
Artificial Analysis SciCode
Artificial Analysis Coding Index
Reasoning4 benchmarks
Artificial Analysis Long Context Reasoning
Critical Physics Tasks
Knowledge12 benchmarks
Humanity's Last Exam
Massive Multitask Language Understanding Professional
Graduate-Level Google-Proof Q&A
SuperGPQA: Scaling LLM Evaluation Across 285 Graduate Disciplines
Artificial Analysis GPQA Diamond
Artificial Analysis Humanity's Last Exam
Artificial Analysis Omniscience Index
Artificial Analysis Omniscience Accuracy
Artificial Analysis Omniscience Hallucination Rate
Math5 benchmarks
AIME 2026
Harvard-MIT Mathematics Tournament February 2026
Harvard-MIT Mathematics Tournament February 2025
Harvard-MIT Mathematics Tournament November 2025
Multilingual2 benchmarks
Multimodal7 benchmarks
Massive Multi-discipline Multimodal Understanding Pro
CharXiv Reasoning
Artificial Analysis MMMU-Pro
Inst. Following2 benchmarks
Instruction-Following Eval
Artificial Analysis IFBench
Frequently Asked Questions
How does Qwen3.5 397B perform overall in AI benchmarks?
Qwen3.5 397B currently ranks #71 out of 200 models on BenchLM's provisional leaderboard with an overall score of 57.01. It is created by Alibaba. Its published context window is 128K.
Is Qwen3.5 397B good for knowledge and understanding?
Qwen3.5 397B ranks #42 out of 52 models in knowledge and understanding benchmarks with an average score of 57.5. There are stronger options in this category.
Is Qwen3.5 397B good for coding and programming?
Qwen3.5 397B ranks #47 out of 122 models in coding and programming benchmarks with an average score of 52.9. There are stronger options in this category.
Is Qwen3.5 397B good for mathematics?
Qwen3.5 397B has visible benchmark coverage in mathematics, but BenchLM does not currently assign it a global category rank there.
Is Qwen3.5 397B good for reasoning and logic?
Qwen3.5 397B has visible benchmark coverage in reasoning and logic, but BenchLM does not currently assign it a global category rank there.
Is Qwen3.5 397B good for agentic tool use and computer tasks?
Qwen3.5 397B ranks #67 out of 119 models in agentic tool use and computer tasks benchmarks with an average score of 46.1. There are stronger options in this category.
Is Qwen3.5 397B good for multimodal and grounded tasks?
Qwen3.5 397B ranks #17 out of 29 models in multimodal and grounded tasks benchmarks with an average score of 66.4. There are stronger options in this category.
Is Qwen3.5 397B good for instruction following?
Qwen3.5 397B ranks #14 out of 38 models in instruction following benchmarks with an average score of 86.5. There are stronger options in this category.
Is Qwen3.5 397B good for multilingual tasks?
Qwen3.5 397B ranks #5 out of 13 models in multilingual tasks benchmarks with an average score of 69.7. It is among the top performers in this category.
Is Qwen3.5 397B open source?
Yes, Qwen3.5 397B is an open weight model created by Alibaba, meaning it can be downloaded and run locally or fine-tuned for specific use cases.
Which sibling models are related to Qwen3.5 397B?
Qwen3.5 397B belongs to the Qwen3.5 397B family. Related variants on BenchLM include Qwen3.5 397B (Reasoning).
Does Qwen3.5 397B have full benchmark coverage on BenchLM?
Not yet. Qwen3.5 397B currently has 55 published benchmark scores out of the 321 benchmarks BenchLM tracks. BenchLM only exposes non-generated public benchmark rows, so missing categories stay blank until a sourced evaluation is available.
What is the context window size of Qwen3.5 397B?
Qwen3.5 397B has a published context window of 128K, which determines how much text it can process in a single interaction.
Related Resources
Choose with this week’s evidence
Join 2,000+ readers for ranking moves, new releases, pricing changes, and the evidence behind them.
Free. One email per week.