o1-preview vs Qwen3.5 397B (Reasoning)

Side-by-side benchmark comparison across knowledge, coding, math, and reasoning.

Quick Verdict

o1-preview wins overall with a score of 71 vs 70 (1 point difference).o1-preview wins 4 out of 4 categories.

Knowledge

o1-preview

o1-preview

89

Qwen3.5 397B (Reasoning)

88

92
MMLU
91
90
GPQA
89
88
SuperGPQA
87
86
OpenBookQA
85

Coding

o1-preview

o1-preview

86

Qwen3.5 397B (Reasoning)

83

86
HumanEval
83

Mathematics

o1-preview

o1-preview

93

Qwen3.5 397B (Reasoning)

92

94
AIME 2023
93
96
AIME 2024
95
95
AIME 2025
94
90
HMMT Feb 2023
89
92
HMMT Feb 2024
91
91
HMMT Feb 2025
90
93
BRUMO 2025
92

Reasoning

o1-preview

o1-preview

87

Qwen3.5 397B (Reasoning)

86

88
SimpleQA
87
86
MuSR
85

Frequently Asked Questions

Which is better, o1-preview or Qwen3.5 397B (Reasoning)?

o1-preview scores higher overall with 71 vs 70, a difference of 1 points across all benchmarks.

Which is better for knowledge tasks, o1-preview or Qwen3.5 397B (Reasoning)?

o1-preview leads in knowledge tasks with an average score of 89 vs 88.

Which is better for coding, o1-preview or Qwen3.5 397B (Reasoning)?

o1-preview leads in coding with an average score of 86 vs 83.

Which is better for math, o1-preview or Qwen3.5 397B (Reasoning)?

o1-preview leads in math with an average score of 93 vs 92.

Which is better for reasoning, o1-preview or Qwen3.5 397B (Reasoning)?

o1-preview leads in reasoning with an average score of 87 vs 86.