benchlm.ai

Claude Sonnet 4.5 vs Nemotron Ultra 253B

Side-by-side benchmark comparison across knowledge, coding, math, and reasoning.

Quick Verdict

Claude Sonnet 4.5 wins overall with a score of 74 vs 40 (34 point difference).Claude Sonnet 4.5 wins 4 out of 4 categories.

Claude Sonnet 4.5

CreatorAnthropic
TypeProprietary
Context1M
Score74

Nemotron Ultra 253B

CreatorNVIDIA
TypeOpen Weight
Context32K
Score40

Knowledge

Claude Sonnet 4.5

Claude Sonnet 4.5

92

Nemotron Ultra 253B

46.8

95
MMLU
49
93
GPQA
48
91
SuperGPQA
46
89
OpenBookQA
44

Coding

Claude Sonnet 4.5

Claude Sonnet 4.5

87

Nemotron Ultra 253B

41

87
HumanEval
41

Mathematics

Claude Sonnet 4.5

Claude Sonnet 4.5

96

Nemotron Ultra 253B

48

97
AIME 2023
49
99
AIME 2024
51
98
AIME 2025
50
93
HMMT Feb 2023
45
95
HMMT Feb 2024
47
94
HMMT Feb 2025
46
96
BRUMO 2025
48

Reasoning

Claude Sonnet 4.5

Claude Sonnet 4.5

90

Nemotron Ultra 253B

46

91
SimpleQA
47
89
MuSR
45

Frequently Asked Questions

Which is better, Claude Sonnet 4.5 or Nemotron Ultra 253B?

Claude Sonnet 4.5 scores higher overall with 74 vs 40, a difference of 34 points across all benchmarks.

Which is better for knowledge tasks, Claude Sonnet 4.5 or Nemotron Ultra 253B?

Claude Sonnet 4.5 leads in knowledge tasks with an average score of 92 vs 46.8.

Which is better for coding, Claude Sonnet 4.5 or Nemotron Ultra 253B?

Claude Sonnet 4.5 leads in coding with an average score of 87 vs 41.

Which is better for math, Claude Sonnet 4.5 or Nemotron Ultra 253B?

Claude Sonnet 4.5 leads in math with an average score of 96 vs 48.

Which is better for reasoning, Claude Sonnet 4.5 or Nemotron Ultra 253B?

Claude Sonnet 4.5 leads in reasoning with an average score of 90 vs 46.

Related Comparisons

Claude Sonnet 4.5 vs GPT-5.4Claude Sonnet 4.5 vs Gemini 3.1 ProClaude Sonnet 4.5 vs Claude Opus 4.6Claude Sonnet 4.5 vs GPT-5.3 CodexClaude Sonnet 4.5 vs Grok 4.1Claude Sonnet 4.5 vs GPT-5.2