benchlm.ai

Claude 3 Haiku vs Nemotron Ultra 253B

Side-by-side benchmark comparison across knowledge, coding, math, and reasoning.

Quick Verdict

Claude 3 Haiku wins overall with a score of 46 vs 40 (6 point difference).Claude 3 Haiku wins 4 out of 4 categories.

Claude 3 Haiku

CreatorAnthropic
TypeProprietary
Context200K
Score46

Nemotron Ultra 253B

CreatorNVIDIA
TypeOpen Weight
Context32K
Score40

Knowledge

Claude 3 Haiku

Claude 3 Haiku

54.5

Nemotron Ultra 253B

46.8

56
MMLU
49
56
GPQA
48
54
SuperGPQA
46
52
OpenBookQA
44

Coding

Claude 3 Haiku

Claude 3 Haiku

48

Nemotron Ultra 253B

41

48
HumanEval
41

Mathematics

Claude 3 Haiku

Claude 3 Haiku

55

Nemotron Ultra 253B

48

56
AIME 2023
49
58
AIME 2024
51
57
AIME 2025
50
52
HMMT Feb 2023
45
54
HMMT Feb 2024
47
53
HMMT Feb 2025
46
55
BRUMO 2025
48

Reasoning

Claude 3 Haiku

Claude 3 Haiku

53

Nemotron Ultra 253B

46

54
SimpleQA
47
52
MuSR
45

Frequently Asked Questions

Which is better, Claude 3 Haiku or Nemotron Ultra 253B?

Claude 3 Haiku scores higher overall with 46 vs 40, a difference of 6 points across all benchmarks.

Which is better for knowledge tasks, Claude 3 Haiku or Nemotron Ultra 253B?

Claude 3 Haiku leads in knowledge tasks with an average score of 54.5 vs 46.8.

Which is better for coding, Claude 3 Haiku or Nemotron Ultra 253B?

Claude 3 Haiku leads in coding with an average score of 48 vs 41.

Which is better for math, Claude 3 Haiku or Nemotron Ultra 253B?

Claude 3 Haiku leads in math with an average score of 55 vs 48.

Which is better for reasoning, Claude 3 Haiku or Nemotron Ultra 253B?

Claude 3 Haiku leads in reasoning with an average score of 53 vs 46.

Related Comparisons

Claude 3 Haiku vs GPT-5.4Claude 3 Haiku vs Gemini 3.1 ProClaude 3 Haiku vs Claude Opus 4.6Claude 3 Haiku vs GPT-5.3 CodexClaude 3 Haiku vs Grok 4.1Claude 3 Haiku vs GPT-5.2