benchlm.ai

Claude 4.1 Opus vs Qwen3.5 397B

Side-by-side benchmark comparison across knowledge, coding, math, and reasoning.

Quick Verdict

Qwen3.5 397B wins overall with a score of 65 vs 61 (4 point difference).Qwen3.5 397B wins 4 out of 4 categories.

Claude 4.1 Opus

CreatorAnthropic
TypeProprietary
Context200K
Score61

Qwen3.5 397B

CreatorAlibaba
TypeOpen Weight
Context128K
Score65

Knowledge

Qwen3.5 397B

Claude 4.1 Opus

74.5

Qwen3.5 397B

80.8

76
MMLU
83
76
GPQA
82
74
SuperGPQA
80
72
OpenBookQA
78

Coding

Qwen3.5 397B

Claude 4.1 Opus

68

Qwen3.5 397B

75

68
HumanEval
75

Mathematics

Qwen3.5 397B

Claude 4.1 Opus

75

Qwen3.5 397B

82

76
AIME 2023
83
78
AIME 2024
85
77
AIME 2025
84
72
HMMT Feb 2023
79
74
HMMT Feb 2024
81
73
HMMT Feb 2025
80
75
BRUMO 2025
82

Reasoning

Qwen3.5 397B

Claude 4.1 Opus

73

Qwen3.5 397B

79

74
SimpleQA
80
72
MuSR
78

Frequently Asked Questions

Which is better, Claude 4.1 Opus or Qwen3.5 397B?

Qwen3.5 397B scores higher overall with 65 vs 61, a difference of 4 points across all benchmarks.

Which is better for knowledge tasks, Claude 4.1 Opus or Qwen3.5 397B?

Qwen3.5 397B leads in knowledge tasks with an average score of 80.8 vs 74.5.

Which is better for coding, Claude 4.1 Opus or Qwen3.5 397B?

Qwen3.5 397B leads in coding with an average score of 75 vs 68.

Which is better for math, Claude 4.1 Opus or Qwen3.5 397B?

Qwen3.5 397B leads in math with an average score of 82 vs 75.

Which is better for reasoning, Claude 4.1 Opus or Qwen3.5 397B?

Qwen3.5 397B leads in reasoning with an average score of 79 vs 73.

Related Comparisons

Claude 4.1 Opus vs GPT-5.4Claude 4.1 Opus vs Gemini 3.1 ProClaude 4.1 Opus vs Claude Opus 4.6Claude 4.1 Opus vs GPT-5.3 CodexClaude 4.1 Opus vs Grok 4.1Claude 4.1 Opus vs GPT-5.2