benchlm.ai

Claude 3 Haiku vs Nemotron-4 15B

Side-by-side benchmark comparison across knowledge, coding, math, and reasoning.

Quick Verdict

Claude 3 Haiku wins overall with a score of 46 vs 45 (1 point difference).Claude 3 Haiku wins 4 out of 4 categories.

Claude 3 Haiku

CreatorAnthropic
TypeProprietary
Context200K
Score46

Nemotron-4 15B

CreatorNVIDIA
TypeOpen Weight
Context32K
Score45

Knowledge

Claude 3 Haiku

Claude 3 Haiku

54.5

Nemotron-4 15B

51.8

56
MMLU
54
56
GPQA
53
54
SuperGPQA
51
52
OpenBookQA
49

Coding

Claude 3 Haiku

Claude 3 Haiku

48

Nemotron-4 15B

46

48
HumanEval
46

Mathematics

Claude 3 Haiku

Claude 3 Haiku

55

Nemotron-4 15B

53

56
AIME 2023
54
58
AIME 2024
56
57
AIME 2025
55
52
HMMT Feb 2023
50
54
HMMT Feb 2024
52
53
HMMT Feb 2025
51
55
BRUMO 2025
53

Reasoning

Claude 3 Haiku

Claude 3 Haiku

53

Nemotron-4 15B

51

54
SimpleQA
52
52
MuSR
50

Frequently Asked Questions

Which is better, Claude 3 Haiku or Nemotron-4 15B?

Claude 3 Haiku scores higher overall with 46 vs 45, a difference of 1 points across all benchmarks.

Which is better for knowledge tasks, Claude 3 Haiku or Nemotron-4 15B?

Claude 3 Haiku leads in knowledge tasks with an average score of 54.5 vs 51.8.

Which is better for coding, Claude 3 Haiku or Nemotron-4 15B?

Claude 3 Haiku leads in coding with an average score of 48 vs 46.

Which is better for math, Claude 3 Haiku or Nemotron-4 15B?

Claude 3 Haiku leads in math with an average score of 55 vs 53.

Which is better for reasoning, Claude 3 Haiku or Nemotron-4 15B?

Claude 3 Haiku leads in reasoning with an average score of 53 vs 51.

Related Comparisons

Claude 3 Haiku vs GPT-5.4Claude 3 Haiku vs Gemini 3.1 ProClaude 3 Haiku vs Claude Opus 4.6Claude 3 Haiku vs GPT-5.3 CodexClaude 3 Haiku vs Grok 4.1Claude 3 Haiku vs GPT-5.2