benchlm.ai

Claude 3.5 Sonnet vs Nemotron-4 15B

Side-by-side benchmark comparison across knowledge, coding, math, and reasoning.

Quick Verdict

Claude 3.5 Sonnet wins overall with a score of 55 vs 45 (10 point difference).Claude 3.5 Sonnet wins 4 out of 4 categories.

Claude 3.5 Sonnet

CreatorAnthropic
TypeProprietary
Context200K
Score55

Nemotron-4 15B

CreatorNVIDIA
TypeOpen Weight
Context32K
Score45

Knowledge

Claude 3.5 Sonnet

Claude 3.5 Sonnet

63.5

Nemotron-4 15B

51.8

65
MMLU
54
65
GPQA
53
63
SuperGPQA
51
61
OpenBookQA
49

Coding

Claude 3.5 Sonnet

Claude 3.5 Sonnet

57

Nemotron-4 15B

46

57
HumanEval
46

Mathematics

Claude 3.5 Sonnet

Claude 3.5 Sonnet

64

Nemotron-4 15B

53

65
AIME 2023
54
67
AIME 2024
56
66
AIME 2025
55
61
HMMT Feb 2023
50
63
HMMT Feb 2024
52
62
HMMT Feb 2025
51
64
BRUMO 2025
53

Reasoning

Claude 3.5 Sonnet

Claude 3.5 Sonnet

62

Nemotron-4 15B

51

63
SimpleQA
52
61
MuSR
50

Frequently Asked Questions

Which is better, Claude 3.5 Sonnet or Nemotron-4 15B?

Claude 3.5 Sonnet scores higher overall with 55 vs 45, a difference of 10 points across all benchmarks.

Which is better for knowledge tasks, Claude 3.5 Sonnet or Nemotron-4 15B?

Claude 3.5 Sonnet leads in knowledge tasks with an average score of 63.5 vs 51.8.

Which is better for coding, Claude 3.5 Sonnet or Nemotron-4 15B?

Claude 3.5 Sonnet leads in coding with an average score of 57 vs 46.

Which is better for math, Claude 3.5 Sonnet or Nemotron-4 15B?

Claude 3.5 Sonnet leads in math with an average score of 64 vs 53.

Which is better for reasoning, Claude 3.5 Sonnet or Nemotron-4 15B?

Claude 3.5 Sonnet leads in reasoning with an average score of 62 vs 51.

Related Comparisons

Claude 3.5 Sonnet vs GPT-5.4Claude 3.5 Sonnet vs Gemini 3.1 ProClaude 3.5 Sonnet vs Claude Opus 4.6Claude 3.5 Sonnet vs GPT-5.3 CodexClaude 3.5 Sonnet vs Grok 4.1Claude 3.5 Sonnet vs GPT-5.2