benchlm.ai

Claude Sonnet 4.6 vs Nemotron Ultra 253B

Side-by-side benchmark comparison across knowledge, coding, math, and reasoning.

Quick Verdict

Claude Sonnet 4.6 wins overall with a score of 80 vs 40 (40 point difference).Claude Sonnet 4.6 wins 4 out of 4 categories.

Claude Sonnet 4.6

CreatorAnthropic
TypeProprietary
Context1M
Score80

Nemotron Ultra 253B

CreatorNVIDIA
TypeOpen Weight
Context32K
Score40

Knowledge

Claude Sonnet 4.6

Claude Sonnet 4.6

96

Nemotron Ultra 253B

46.8

99
MMLU
49
97
GPQA
48
95
SuperGPQA
46
93
OpenBookQA
44

Coding

Claude Sonnet 4.6

Claude Sonnet 4.6

93

Nemotron Ultra 253B

41

93
HumanEval
41

Mathematics

Claude Sonnet 4.6

Claude Sonnet 4.6

97.1

Nemotron Ultra 253B

48

99
AIME 2023
49
99
AIME 2024
51
98
AIME 2025
50
95
HMMT Feb 2023
45
97
HMMT Feb 2024
47
96
HMMT Feb 2025
46
96
BRUMO 2025
48

Reasoning

Claude Sonnet 4.6

Claude Sonnet 4.6

94

Nemotron Ultra 253B

46

95
SimpleQA
47
93
MuSR
45

Frequently Asked Questions

Which is better, Claude Sonnet 4.6 or Nemotron Ultra 253B?

Claude Sonnet 4.6 scores higher overall with 80 vs 40, a difference of 40 points across all benchmarks.

Which is better for knowledge tasks, Claude Sonnet 4.6 or Nemotron Ultra 253B?

Claude Sonnet 4.6 leads in knowledge tasks with an average score of 96 vs 46.8.

Which is better for coding, Claude Sonnet 4.6 or Nemotron Ultra 253B?

Claude Sonnet 4.6 leads in coding with an average score of 93 vs 41.

Which is better for math, Claude Sonnet 4.6 or Nemotron Ultra 253B?

Claude Sonnet 4.6 leads in math with an average score of 97.1 vs 48.

Which is better for reasoning, Claude Sonnet 4.6 or Nemotron Ultra 253B?

Claude Sonnet 4.6 leads in reasoning with an average score of 94 vs 46.

Related Comparisons

Claude Sonnet 4.6 vs GPT-5.4Claude Sonnet 4.6 vs Gemini 3.1 ProClaude Sonnet 4.6 vs Claude Opus 4.6Claude Sonnet 4.6 vs GPT-5.3 CodexClaude Sonnet 4.6 vs Grok 4.1Claude Sonnet 4.6 vs GPT-5.2