benchlm.ai

Claude Haiku 4.5 vs Nemotron Ultra 253B

Side-by-side benchmark comparison across knowledge, coding, math, and reasoning.

Quick Verdict

Claude Haiku 4.5 wins overall with a score of 57 vs 40 (17 point difference).Claude Haiku 4.5 wins 4 out of 4 categories.

Claude Haiku 4.5

CreatorAnthropic
TypeProprietary
Context200K
Score57

Nemotron Ultra 253B

CreatorNVIDIA
TypeOpen Weight
Context32K
Score40

Knowledge

Claude Haiku 4.5

Claude Haiku 4.5

65.8

Nemotron Ultra 253B

46.8

68
MMLU
49
67
GPQA
48
65
SuperGPQA
46
63
OpenBookQA
44

Coding

Claude Haiku 4.5

Claude Haiku 4.5

60

Nemotron Ultra 253B

41

60
HumanEval
41

Mathematics

Claude Haiku 4.5

Claude Haiku 4.5

67

Nemotron Ultra 253B

48

68
AIME 2023
49
70
AIME 2024
51
69
AIME 2025
50
64
HMMT Feb 2023
45
66
HMMT Feb 2024
47
65
HMMT Feb 2025
46
67
BRUMO 2025
48

Reasoning

Claude Haiku 4.5

Claude Haiku 4.5

64

Nemotron Ultra 253B

46

65
SimpleQA
47
63
MuSR
45

Frequently Asked Questions

Which is better, Claude Haiku 4.5 or Nemotron Ultra 253B?

Claude Haiku 4.5 scores higher overall with 57 vs 40, a difference of 17 points across all benchmarks.

Which is better for knowledge tasks, Claude Haiku 4.5 or Nemotron Ultra 253B?

Claude Haiku 4.5 leads in knowledge tasks with an average score of 65.8 vs 46.8.

Which is better for coding, Claude Haiku 4.5 or Nemotron Ultra 253B?

Claude Haiku 4.5 leads in coding with an average score of 60 vs 41.

Which is better for math, Claude Haiku 4.5 or Nemotron Ultra 253B?

Claude Haiku 4.5 leads in math with an average score of 67 vs 48.

Which is better for reasoning, Claude Haiku 4.5 or Nemotron Ultra 253B?

Claude Haiku 4.5 leads in reasoning with an average score of 64 vs 46.

Related Comparisons

Claude Haiku 4.5 vs GPT-5.4Claude Haiku 4.5 vs Gemini 3.1 ProClaude Haiku 4.5 vs Claude Opus 4.6Claude Haiku 4.5 vs GPT-5.3 CodexClaude Haiku 4.5 vs Grok 4.1Claude Haiku 4.5 vs GPT-5.2