benchlm.ai

Claude 3.5 Sonnet vs Z-1

Side-by-side benchmark comparison across knowledge, coding, math, and reasoning.

Quick Verdict

Claude 3.5 Sonnet wins overall with a score of 55 vs 43 (12 point difference).Claude 3.5 Sonnet wins 4 out of 4 categories.

Claude 3.5 Sonnet

CreatorAnthropic
TypeProprietary
Context200K
Score55

Z-1

CreatorZ
TypeProprietary
Context128K
Score43

Knowledge

Claude 3.5 Sonnet

Claude 3.5 Sonnet

63.5

Z-1

49.8

65
MMLU
52
65
GPQA
51
63
SuperGPQA
49
61
OpenBookQA
47

Coding

Claude 3.5 Sonnet

Claude 3.5 Sonnet

57

Z-1

44

57
HumanEval
44

Mathematics

Claude 3.5 Sonnet

Claude 3.5 Sonnet

64

Z-1

51

65
AIME 2023
52
67
AIME 2024
54
66
AIME 2025
53
61
HMMT Feb 2023
48
63
HMMT Feb 2024
50
62
HMMT Feb 2025
49
64
BRUMO 2025
51

Reasoning

Claude 3.5 Sonnet

Claude 3.5 Sonnet

62

Z-1

49

63
SimpleQA
50
61
MuSR
48

Frequently Asked Questions

Which is better, Claude 3.5 Sonnet or Z-1?

Claude 3.5 Sonnet scores higher overall with 55 vs 43, a difference of 12 points across all benchmarks.

Which is better for knowledge tasks, Claude 3.5 Sonnet or Z-1?

Claude 3.5 Sonnet leads in knowledge tasks with an average score of 63.5 vs 49.8.

Which is better for coding, Claude 3.5 Sonnet or Z-1?

Claude 3.5 Sonnet leads in coding with an average score of 57 vs 44.

Which is better for math, Claude 3.5 Sonnet or Z-1?

Claude 3.5 Sonnet leads in math with an average score of 64 vs 51.

Which is better for reasoning, Claude 3.5 Sonnet or Z-1?

Claude 3.5 Sonnet leads in reasoning with an average score of 62 vs 49.

Related Comparisons

Claude 3.5 Sonnet vs GPT-5.4Claude 3.5 Sonnet vs Gemini 3.1 ProClaude 3.5 Sonnet vs Claude Opus 4.6Claude 3.5 Sonnet vs GPT-5.3 CodexClaude 3.5 Sonnet vs Grok 4.1Claude 3.5 Sonnet vs GPT-5.2