benchlm.ai

Claude 4 Sonnet vs o1-preview

Side-by-side benchmark comparison across knowledge, coding, math, and reasoning.

Quick Verdict

o1-preview wins overall with a score of 71 vs 59 (12 point difference).o1-preview wins 4 out of 4 categories.

Claude 4 Sonnet

CreatorAnthropic
TypeProprietary
Context200K
Score59

o1-preview

CreatorOpenAI
TypeProprietary
Context200K
Score71

Knowledge

o1-preview

Claude 4 Sonnet

71.5

o1-preview

89

73
MMLU
92
73
GPQA
90
71
SuperGPQA
88
69
OpenBookQA
86

Coding

o1-preview

Claude 4 Sonnet

65

o1-preview

86

65
HumanEval
86

Mathematics

o1-preview

Claude 4 Sonnet

72

o1-preview

93

73
AIME 2023
94
75
AIME 2024
96
74
AIME 2025
95
69
HMMT Feb 2023
90
71
HMMT Feb 2024
92
70
HMMT Feb 2025
91
72
BRUMO 2025
93

Reasoning

o1-preview

Claude 4 Sonnet

70

o1-preview

87

71
SimpleQA
88
69
MuSR
86

Frequently Asked Questions

Which is better, Claude 4 Sonnet or o1-preview?

o1-preview scores higher overall with 71 vs 59, a difference of 12 points across all benchmarks.

Which is better for knowledge tasks, Claude 4 Sonnet or o1-preview?

o1-preview leads in knowledge tasks with an average score of 89 vs 71.5.

Which is better for coding, Claude 4 Sonnet or o1-preview?

o1-preview leads in coding with an average score of 86 vs 65.

Which is better for math, Claude 4 Sonnet or o1-preview?

o1-preview leads in math with an average score of 93 vs 72.

Which is better for reasoning, Claude 4 Sonnet or o1-preview?

o1-preview leads in reasoning with an average score of 87 vs 70.

Related Comparisons

Claude 4 Sonnet vs GPT-5.4Claude 4 Sonnet vs Gemini 3.1 ProClaude 4 Sonnet vs Claude Opus 4.6Claude 4 Sonnet vs GPT-5.3 CodexClaude 4 Sonnet vs Grok 4.1Claude 4 Sonnet vs GPT-5.2