# Claude Sonnet 4.6 vs Qwen3.5 397B

> Side-by-side benchmark comparison for Claude Sonnet 4.6 and Qwen3.5 397B across agentic, coding, multimodal, knowledge, reasoning, multilingual, and math tasks.

- Canonical page: https://benchlm.ai/compare/claude-sonnet-4-6-vs-qwen3-5-397b
- Last updated: October 17, 2026

- Shared sourced benchmarks: 11
- HTML indexing: indexable
- Ranking lane: BenchAlign v5.8

## Quick Verdict

Claude Sonnet 4.6 leads by point estimate. Conditional score ranges do not establish rank confidence. Choose using the category evidence and your own workload tests.

## Summary

- Claude Sonnet 4.6 has the higher overall point estimate 55.89 to 55.34. Conditional score ranges do not establish rank confidence.
- The clearest category separation is in instruction following, where the averages are 48 for Claude Sonnet 4.6 and 79.9 for Qwen3.5 397B.
- The biggest single benchmark swing is SuperGPQA in Knowledge, with scores of 95% and 70.4%.
- Qwen3.5 397B is the cheaper option on output tokens, which matters if you expect large responses or heavy interactive use.
- Claude Sonnet 4.6 also has the larger context window at 200K.

## Model Snapshot

| Property | Claude Sonnet 4.6 | Qwen3.5 397B |
|----------|----------|----------|
| Creator | Anthropic | Alibaba |
| Type | Proprietary | Open Weight |
| Reasoning | Non-Reasoning | Non-Reasoning |
| Context | 200K | 128K |
| Overall Score | 55.89 | 55.34 |
| Benchmarks Covered | 28 | 62 |
| Pricing (input/output) | $3.00 / $15.00 | $0.60 / $3.60 |

## Category Breakdown

### Agentic

- Winner: Directional only
- Claude Sonnet 4.6 public-lane score: 46.3 (Supported · #55/128)
- Qwen3.5 397B public-lane score: 43.8 (Estimated · #61/128)

| Benchmark | Claude Sonnet 4.6 | Qwen3.5 397B | Winner |
|-----------|-----------|-----------|--------|
| Terminal-Bench 2.0 | 59.1% | 52.5% | Claude Sonnet 4.6 |
| OSWorld-Verified | 72.1% | 62.2% | Claude Sonnet 4.6 |
| Claw-Eval | 67.8% | 56.8% | Claude Sonnet 4.6 |
| CyberGym | 65.2% | Coming soon | Coming soon |
| Gert Labs | 62.92% | 46.76% | Claude Sonnet 4.6 |
| OSWorld 2.0 | 8.3% | Coming soon | Coming soon |
| JobBench | 36.9% | Coming soon | Coming soon |
| Terminal-Bench 2.1 (Vals) | 57.3% | Coming soon | Coming soon |
| ApprenticeBench | 2% | Coming soon | Coming soon |
| MazeBench | 0% | Coming soon | Coming soon |
| BrowseComp | Coming soon | 69% | Coming soon |
| QwenClawBench | Coming soon | 51.8% | Coming soon |
| τ³-bench results | Coming soon | 68.4% | Coming soon |
| VITA-Bench | Coming soon | 43.7% | Coming soon |
| DeepPlanning | Coming soon | 37.6% | Coming soon |
| Toolathlon | Coming soon | 36.3% | Coming soon |
| MCP Atlas | Coming soon | 46.1% | Coming soon |
| MCP-Tasks | Coming soon | 74.2% | Coming soon |
| WideResearch | Coming soon | 74.0% | Coming soon |
| ResearchClawBench | Coming soon | 14.2% | Coming soon |

### Coding

- Winner: Not comparable
- Claude Sonnet 4.6 public-lane score: 44.7 (Supported · #54/150)
- Qwen3.5 397B public-lane score: Coming soon

| Benchmark | Claude Sonnet 4.6 | Qwen3.5 397B | Winner |
|-----------|-----------|-----------|--------|
| SWE-bench Verified | 79.6% | 76.2% | Claude Sonnet 4.6 |
| SWE-Rebench | 60.7% | Coming soon | Coming soon |
| React Native Evals | 80.6% | Coming soon | Coming soon |
| Terminal-Bench 2.0 | 59.1% | 52.5% | Claude Sonnet 4.6 |
| Vibe Code Bench | 51.48% | Coming soon | Coming soon |
| cursorBench31 | 48.8% | Coming soon | Coming soon |
| FrontierCode 1.1 Main | 24.3% | Coming soon | Coming soon |
| LiveCodeBench (Vals) | 82.1% | Coming soon | Coming soon |
| SWE-bench (Vals) | 77.4% | Coming soon | Coming soon |
| LiveCodeBench v6 | Coming soon | 83.6% | Coming soon |
| SWE-bench Pro | Coming soon | 50.9% | Coming soon |
| SWE Multilingual | Coming soon | 69.3% | Coming soon |
| NL2Repo | Coming soon | 32.2% | Coming soon |

### Reasoning

- Winner: Not comparable
- Claude Sonnet 4.6 public-lane score: 62.8 (Unranked · 4 rankable rows)
- Qwen3.5 397B public-lane score: 74.9 (Unranked · 2 rankable rows)

| Benchmark | Claude Sonnet 4.6 | Qwen3.5 397B | Winner |
|-----------|-----------|-----------|--------|
| ARC-AGI-2 | 58.3% | Coming soon | Coming soon |
| ARC-AGI-1 | 86.00% | Coming soon | Coming soon |
| LongBench v2 | Coming soon | 63.2% | Coming soon |
| AI-Needle | Coming soon | 68.7% | Coming soon |

### Multimodal & Grounded

- Winner: Directional only
- Claude Sonnet 4.6 public-lane score: 58.7 (#45/54)
- Qwen3.5 397B public-lane score: 73.6 (#29/54)

| Benchmark | Claude Sonnet 4.6 | Qwen3.5 397B | Winner |
|-----------|-----------|-----------|--------|
| CharXiv | 77.4% | 80.8% | Qwen3.5 397B |
| MMMU | Coming soon | 85.0% | Coming soon |
| MMMU-Pro | Coming soon | 79% | Coming soon |
| RealWorldQA | Coming soon | 83.9% | Coming soon |
| OmniDocBench 1.5 | Coming soon | 90.8% | Coming soon |
| Video-MME (with subtitle) | Coming soon | 87.5% | Coming soon |
| Video-MME (w/o subtitle) | Coming soon | 83.7% | Coming soon |
| MathVision | Coming soon | 88.6% | Coming soon |
| We-Math | Coming soon | 87.9% | Coming soon |
| DynaMath | Coming soon | 86.3% | Coming soon |
| SimpleVQA | Coming soon | 67.1% | Coming soon |
| MMLongBench-Doc | Coming soon | 61.5% | Coming soon |
| CC-OCR | Coming soon | 82.0% | Coming soon |
| AI2D_TEST | Coming soon | 93.9% | Coming soon |
| CountBench | Coming soon | 97.2% | Coming soon |
| RefCOCO (avg) | Coming soon | 92.3% | Coming soon |
| ODINW13 | Coming soon | 47.0% | Coming soon |
| ERQA | Coming soon | 67.5% | Coming soon |
| VideoMMMU | Coming soon | 84.7% | Coming soon |
| MLVU (M-Avg) | Coming soon | 86.7% | Coming soon |
| ScreenSpot Pro | Coming soon | 65.6% | Coming soon |
| V* | Coming soon | 95.8% | Coming soon |

### Knowledge

- Winner: Directional only
- Claude Sonnet 4.6 public-lane score: 55.4 (Supported · #58/184)
- Qwen3.5 397B public-lane score: 53.1 (Estimated · #68/184)

| Benchmark | Claude Sonnet 4.6 | Qwen3.5 397B | Winner |
|-----------|-----------|-----------|--------|
| GPQA | 89.9% | 88.4% | Claude Sonnet 4.6 |
| SuperGPQA | 95% | 70.4% | Claude Sonnet 4.6 |
| MMLU-Pro | 79.2% | 87.8% | Qwen3.5 397B |
| HLE | 49% | 28.7% | Claude Sonnet 4.6 |
| GPQA Diamond (Vals) | 85.6% | Coming soon | Coming soon |
| MMLU-Pro (Vals) | 87.3% | Coming soon | Coming soon |
| MMLU-Redux | Coming soon | 94.9% | Coming soon |
| C-Eval | Coming soon | 93% | Coming soon |

### Multilingual

- Winner: Not comparable
- Claude Sonnet 4.6 public-lane score: Coming soon
- Qwen3.5 397B public-lane score: 93.8 (#5/17)

| Benchmark | Claude Sonnet 4.6 | Qwen3.5 397B | Winner |
|-----------|-----------|-----------|--------|
| MMLU-ProX | Coming soon | 84.7% | Coming soon |
| NOVA-63 | Coming soon | 59.1% | Coming soon |
| INCLUDE | Coming soon | 85.6% | Coming soon |
| PolyMath | Coming soon | 73.3% | Coming soon |
| MAXIFE | Coming soon | 88.2% | Coming soon |

### Instruction Following

- Winner: Directional only
- Claude Sonnet 4.6 public-lane score: 48 (#99/148)
- Qwen3.5 397B public-lane score: 79.9 (#59/148)

| Benchmark | Claude Sonnet 4.6 | Qwen3.5 397B | Winner |
|-----------|-----------|-----------|--------|
| IFEval | Coming soon | 92.6% | Coming soon |
| IFBench | Coming soon | 76.5% | Coming soon |

### Mathematics

- Winner: Not comparable
- Claude Sonnet 4.6 public-lane score: Coming soon
- Qwen3.5 397B public-lane score: 81.7 (Unranked · 5 rankable rows)

| Benchmark | Claude Sonnet 4.6 | Qwen3.5 397B | Winner |
|-----------|-----------|-----------|--------|
| AIME26 | Coming soon | 93.3% | Coming soon |
| HMMT Feb 2025 | Coming soon | 94.8% | Coming soon |
| HMMT Nov 2025 | Coming soon | 92.7% | Coming soon |
| HMMT Feb 2026 | Coming soon | 87.9% | Coming soon |
| MMAnswerBench | Coming soon | 80.9% | Coming soon |

## FAQ

### Which is better overall, Claude Sonnet 4.6 or Qwen3.5 397B?

Claude Sonnet 4.6 has the higher overall point estimate. Conditional score ranges do not establish rank confidence.

### Where is the biggest gap between Claude Sonnet 4.6 and Qwen3.5 397B?

The widest category gap is in instruction following, where the averages are 48 for Claude Sonnet 4.6 and 79.9 for Qwen3.5 397B.

### How many benchmarks does Claude Sonnet 4.6 cover on BenchLM?

Claude Sonnet 4.6 currently has 28 sourced benchmark scores on BenchLM.

### How many benchmarks does Qwen3.5 397B cover on BenchLM?

Qwen3.5 397B currently has 62 sourced benchmark scores on BenchLM.

## Related Comparisons

- [Claude Sonnet 4.6 vs Qwen3.5 397B (Reasoning)](/compare/claude-sonnet-4-6-vs-qwen3-5-397b-reasoning)
- [Qwen3.5 397B vs Qwen3.5 397B (Reasoning)](/compare/qwen3-5-397b-vs-qwen3-5-397b-reasoning)
- [Claude Sonnet 4.6 vs Claude Opus 5.5](/compare/claude-opus-5-5-vs-claude-sonnet-4-6)
- [Qwen3.5 397B vs Claude Opus 5.5](/compare/claude-opus-5-5-vs-qwen3-5-397b)

## Explore More

- [Claude Sonnet 4.6 profile](/models/claude-sonnet-4-6)
- [Qwen3.5 397B profile](/models/qwen3-5-397b)
- [Compare Pricing](/llm-pricing)
- [Alternative Finder](/tools/alternative-finder)
- [LLM Selector](/tools/llm-selector)
- [Overall Rankings](/best/overall)