Claude 3 Haiku vs Qwen3.5 397B (Reasoning)

Side-by-side benchmark comparison across knowledge, coding, math, and reasoning.

Quick Verdict

Qwen3.5 397B (Reasoning) wins overall with a score of 70 vs 46 (24 point difference).Qwen3.5 397B (Reasoning) wins 4 out of 4 categories.

Knowledge

Qwen3.5 397B (Reasoning)

Claude 3 Haiku

54.5

Qwen3.5 397B (Reasoning)

88

56
MMLU
91
56
GPQA
89
54
SuperGPQA
87
52
OpenBookQA
85

Coding

Qwen3.5 397B (Reasoning)

Claude 3 Haiku

48

Qwen3.5 397B (Reasoning)

83

48
HumanEval
83

Mathematics

Qwen3.5 397B (Reasoning)

Claude 3 Haiku

55

Qwen3.5 397B (Reasoning)

92

56
AIME 2023
93
58
AIME 2024
95
57
AIME 2025
94
52
HMMT Feb 2023
89
54
HMMT Feb 2024
91
53
HMMT Feb 2025
90
55
BRUMO 2025
92

Reasoning

Qwen3.5 397B (Reasoning)

Claude 3 Haiku

53

Qwen3.5 397B (Reasoning)

86

54
SimpleQA
87
52
MuSR
85

Frequently Asked Questions

Which is better, Claude 3 Haiku or Qwen3.5 397B (Reasoning)?

Qwen3.5 397B (Reasoning) scores higher overall with 70 vs 46, a difference of 24 points across all benchmarks.

Which is better for knowledge tasks, Claude 3 Haiku or Qwen3.5 397B (Reasoning)?

Qwen3.5 397B (Reasoning) leads in knowledge tasks with an average score of 88 vs 54.5.

Which is better for coding, Claude 3 Haiku or Qwen3.5 397B (Reasoning)?

Qwen3.5 397B (Reasoning) leads in coding with an average score of 83 vs 48.

Which is better for math, Claude 3 Haiku or Qwen3.5 397B (Reasoning)?

Qwen3.5 397B (Reasoning) leads in math with an average score of 92 vs 55.

Which is better for reasoning, Claude 3 Haiku or Qwen3.5 397B (Reasoning)?

Qwen3.5 397B (Reasoning) leads in reasoning with an average score of 86 vs 53.