# Claude Opus 4.8 vs Qwen3.5 397B

> Side-by-side benchmark comparison for Claude Opus 4.8 and Qwen3.5 397B across agentic, coding, multimodal, knowledge, reasoning, multilingual, and math tasks.

- Canonical page: https://benchlm.ai/compare/claude-opus-4-8-vs-qwen3-5-397b
- Last updated: October 10, 2026

- Shared sourced benchmarks: 14
- HTML indexing: indexable
- Ranking lane: BenchAlign v5.8

## Quick Verdict

Claude Opus 4.8 leads by point estimate. Conditional score ranges do not establish rank confidence. Choose using the category evidence and your own workload tests.

## Summary

- Claude Opus 4.8 has the higher overall point estimate 69.12 to 55.53. Conditional score ranges do not establish rank confidence.
- The clearest category separation is in agentic, where the averages are 61.6 for Claude Opus 4.8 and 43.8 for Qwen3.5 397B.
- The biggest single benchmark swing is MCP Atlas in Agentic, with scores of 82.2% and 46.1%.
- Qwen3.5 397B is the cheaper option on output tokens, which matters if you expect large responses or heavy interactive use.
- Claude Opus 4.8 also has the larger context window at 1M.

## Model Snapshot

| Property | Claude Opus 4.8 | Qwen3.5 397B |
|----------|----------|----------|
| Creator | Anthropic | Alibaba |
| Type | Proprietary | Open Weight |
| Reasoning | Reasoning | Non-Reasoning |
| Context | 1M | 128K |
| Overall Score | 69.12 | 55.53 |
| Benchmarks Covered | 40 | 62 |
| Pricing (input/output) | $5.00 / $25.00 | $0.60 / $3.60 |

## Category Breakdown

### Agentic

- Winner: Directional only
- Claude Opus 4.8 public-lane score: 61.6 (Supported · #20/123)
- Qwen3.5 397B public-lane score: 43.8 (Estimated · #56/123)

| Benchmark | Claude Opus 4.8 | Qwen3.5 397B | Winner |
|-----------|-----------|-----------|--------|
| Terminal-Bench 3.0 | 21.1% | Coming soon | Coming soon |
| Terminal-Bench 2.1 | 74.6% | Coming soon | Coming soon |
| BrowseComp | 84.3% | 69% | Claude Opus 4.8 |
| DeepSearchQA | 93.1% | Coming soon | Coming soon |
| OSWorld-Verified | 83.4% | 62.2% | Claude Opus 4.8 |
| Finance Agent v2 | 53.9% | Coming soon | Coming soon |
| MCP Atlas | 82.2% | 46.1% | Claude Opus 4.8 |
| Toolathlon | 59.9% | 36.3% | Claude Opus 4.8 |
| Gert Labs | 72.97% | 46.76% | Claude Opus 4.8 |
| ResearchClawBench | 21.1% | 14.2% | Claude Opus 4.8 |
| OSWorld 2.0 | 20.6% | Coming soon | Coming soon |
| Terminal-Bench 2.1 (Vals) | 71.9% | Coming soon | Coming soon |
| Terminal-Bench 2.0 | Coming soon | 52.5% | Coming soon |
| Claw-Eval | Coming soon | 56.8% | Coming soon |
| QwenClawBench | Coming soon | 51.8% | Coming soon |
| τ³-bench results | Coming soon | 68.4% | Coming soon |
| VITA-Bench | Coming soon | 43.7% | Coming soon |
| DeepPlanning | Coming soon | 37.6% | Coming soon |
| MCP-Tasks | Coming soon | 74.2% | Coming soon |
| WideResearch | Coming soon | 74.0% | Coming soon |

### Coding

- Winner: Not comparable
- Claude Opus 4.8 public-lane score: 60.8 (Supported · #19/146)
- Qwen3.5 397B public-lane score: Coming soon

| Benchmark | Claude Opus 4.8 | Qwen3.5 397B | Winner |
|-----------|-----------|-----------|--------|
| SWE-bench Verified | 88.6% | 76.2% | Claude Opus 4.8 |
| SWE-bench Pro | 69.2% | 50.9% | Claude Opus 4.8 |
| SWE Multilingual | 84.4% | 69.3% | Claude Opus 4.8 |
| SWE Multimodal | 38.4% | Coming soon | Coming soon |
| Terminal-Bench 2.1 | 74.6% | Coming soon | Coming soon |
| cursorBench31 | 58.4% | Coming soon | Coming soon |
| CursorBench 3.2 | 62.3% | Coming soon | Coming soon |
| FrontierCode 1.1 Main | 46.5% | Coming soon | Coming soon |
| LiveCodeBench (Vals) | 87.8% | Coming soon | Coming soon |
| SWE-bench (Vals) | 88.6% | Coming soon | Coming soon |
| PostTrainBench v1.1 | 32.9% | Coming soon | Coming soon |
| LiveCodeBench v6 | Coming soon | 83.6% | Coming soon |
| NL2Repo | Coming soon | 32.2% | Coming soon |
| Terminal-Bench 2.0 | Coming soon | 52.5% | Coming soon |

### Reasoning

- Winner: Not comparable
- Claude Opus 4.8 public-lane score: 62.9 (#24/28)
- Qwen3.5 397B public-lane score: 74.9 (Unranked · 2 rankable rows)

| Benchmark | Claude Opus 4.8 | Qwen3.5 397B | Winner |
|-----------|-----------|-----------|--------|
| ARC-AGI-2 | 72.1% | Coming soon | Coming soon |
| ARC-AGI-3 | 1.5% | Coming soon | Coming soon |
| ARC-AGI-1 | 92.50% | Coming soon | Coming soon |
| LongBench v2 | Coming soon | 63.2% | Coming soon |
| AI-Needle | Coming soon | 68.7% | Coming soon |

### Multimodal & Grounded

- Winner: Directional only
- Claude Opus 4.8 public-lane score: 91.2 (#5/54)
- Qwen3.5 397B public-lane score: 73.6 (#29/54)

| Benchmark | Claude Opus 4.8 | Qwen3.5 397B | Winner |
|-----------|-----------|-----------|--------|
| OfficeQA Pro | 66.2% | Coming soon | Coming soon |
| ScreenSpot Pro | 87.9% | 65.6% | Claude Opus 4.8 |
| CharXiv | 89.9% | 80.8% | Claude Opus 4.8 |
| CharXiv w/o tools | 80.5% | Coming soon | Coming soon |
| MMMU | Coming soon | 85.0% | Coming soon |
| MMMU-Pro | Coming soon | 79% | Coming soon |
| RealWorldQA | Coming soon | 83.9% | Coming soon |
| OmniDocBench 1.5 | Coming soon | 90.8% | Coming soon |
| Video-MME (with subtitle) | Coming soon | 87.5% | Coming soon |
| Video-MME (w/o subtitle) | Coming soon | 83.7% | Coming soon |
| MathVision | Coming soon | 88.6% | Coming soon |
| We-Math | Coming soon | 87.9% | Coming soon |
| DynaMath | Coming soon | 86.3% | Coming soon |
| SimpleVQA | Coming soon | 67.1% | Coming soon |
| MMLongBench-Doc | Coming soon | 61.5% | Coming soon |
| CC-OCR | Coming soon | 82.0% | Coming soon |
| AI2D_TEST | Coming soon | 93.9% | Coming soon |
| CountBench | Coming soon | 97.2% | Coming soon |
| RefCOCO (avg) | Coming soon | 92.3% | Coming soon |
| ODINW13 | Coming soon | 47.0% | Coming soon |
| ERQA | Coming soon | 67.5% | Coming soon |
| VideoMMMU | Coming soon | 84.7% | Coming soon |
| MLVU (M-Avg) | Coming soon | 86.7% | Coming soon |
| V* | Coming soon | 95.8% | Coming soon |

### Knowledge

- Winner: Directional only
- Claude Opus 4.8 public-lane score: 70.7 (Supported · #14/177)
- Qwen3.5 397B public-lane score: 53.8 (Estimated · #63/177)

| Benchmark | Claude Opus 4.8 | Qwen3.5 397B | Winner |
|-----------|-----------|-----------|--------|
| GPQA | 93.6% | 88.4% | Claude Opus 4.8 |
| GPQA-D | 93.6% | Coming soon | Coming soon |
| HLE | 57.9% | 28.7% | Claude Opus 4.8 |
| HLE w/o tools | 49.8% | Coming soon | Coming soon |
| GPQA Diamond (Vals) | 92.4% | Coming soon | Coming soon |
| MMLU-Pro (Vals) | 89.6% | Coming soon | Coming soon |
| SuperGPQA | Coming soon | 70.4% | Coming soon |
| MMLU-Pro | Coming soon | 87.8% | Coming soon |
| MMLU-Redux | Coming soon | 94.9% | Coming soon |
| C-Eval | Coming soon | 93% | Coming soon |

### Multilingual

- Winner: Not comparable
- Claude Opus 4.8 public-lane score: Coming soon
- Qwen3.5 397B public-lane score: 93.8 (#5/17)

| Benchmark | Claude Opus 4.8 | Qwen3.5 397B | Winner |
|-----------|-----------|-----------|--------|
| INCLUDE | 87.6% | 85.6% | Claude Opus 4.8 |
| MMLU-ProX | Coming soon | 84.7% | Coming soon |
| NOVA-63 | Coming soon | 59.1% | Coming soon |
| PolyMath | Coming soon | 73.3% | Coming soon |
| MAXIFE | Coming soon | 88.2% | Coming soon |

### Instruction Following

- Winner: Directional only
- Claude Opus 4.8 public-lane score: 75.4 (#61/127)
- Qwen3.5 397B public-lane score: 79.9 (#56/127)

| Benchmark | Claude Opus 4.8 | Qwen3.5 397B | Winner |
|-----------|-----------|-----------|--------|
| IFEval | Coming soon | 92.6% | Coming soon |
| IFBench | Coming soon | 76.5% | Coming soon |

### Mathematics

- Winner: Not comparable
- Claude Opus 4.8 public-lane score: 65.7 (#2/7)
- Qwen3.5 397B public-lane score: 75 (Unranked · 5 rankable rows)

| Benchmark | Claude Opus 4.8 | Qwen3.5 397B | Winner |
|-----------|-----------|-----------|--------|
| USAMO 2026 | 96.7% | Coming soon | Coming soon |
| FrontierMath v2 (Tiers 1-3) | 47.241% | Coming soon | Coming soon |
| FrontierMath v2 (Tier 4) | 31.250% | Coming soon | Coming soon |
| AIME26 | Coming soon | 93.3% | Coming soon |
| HMMT Feb 2025 | Coming soon | 94.8% | Coming soon |
| HMMT Nov 2025 | Coming soon | 92.7% | Coming soon |
| HMMT Feb 2026 | Coming soon | 87.9% | Coming soon |
| MMAnswerBench | Coming soon | 80.9% | Coming soon |

## FAQ

### Which is better overall, Claude Opus 4.8 or Qwen3.5 397B?

Claude Opus 4.8 has the higher overall point estimate. Conditional score ranges do not establish rank confidence.

### Where is the biggest gap between Claude Opus 4.8 and Qwen3.5 397B?

The widest category gap is in agentic, where the averages are 61.6 for Claude Opus 4.8 and 43.8 for Qwen3.5 397B.

### How many benchmarks does Claude Opus 4.8 cover on BenchLM?

Claude Opus 4.8 currently has 40 sourced benchmark scores on BenchLM.

### How many benchmarks does Qwen3.5 397B cover on BenchLM?

Qwen3.5 397B currently has 62 sourced benchmark scores on BenchLM.

## Related Comparisons

- [Claude Opus 4.8 vs Qwen3.5 397B (Reasoning)](/compare/claude-opus-4-8-vs-qwen3-5-397b-reasoning)
- [Qwen3.5 397B vs Qwen3.5 397B (Reasoning)](/compare/qwen3-5-397b-vs-qwen3-5-397b-reasoning)
- [Claude Opus 4.8 vs Claude Opus 5.5](/compare/claude-opus-4-8-vs-claude-opus-5-5)
- [Qwen3.5 397B vs Claude Opus 5.5](/compare/claude-opus-5-5-vs-qwen3-5-397b)

## Explore More

- [Claude Opus 4.8 profile](/models/claude-opus-4-8)
- [Qwen3.5 397B profile](/models/qwen3-5-397b)
- [Compare Pricing](/llm-pricing)
- [Alternative Finder](/tools/alternative-finder)
- [LLM Selector](/tools/llm-selector)
- [Overall Rankings](/best/overall)