benchlm.ai

Gemma 3 27B vs Nemotron Ultra 253B

Side-by-side benchmark comparison across knowledge, coding, math, and reasoning.

Quick Verdict

Nemotron Ultra 253B wins overall with a score of 40 vs 36 (4 point difference).Nemotron Ultra 253B wins 4 out of 4 categories.

Gemma 3 27B

CreatorGoogle
TypeOpen Weight
Context32K
Score36

Nemotron Ultra 253B

CreatorNVIDIA
TypeOpen Weight
Context32K
Score40

Knowledge

Nemotron Ultra 253B

Gemma 3 27B

42.8

Nemotron Ultra 253B

46.8

45
MMLU
49
44
GPQA
48
42
SuperGPQA
46
40
OpenBookQA
44

Coding

Nemotron Ultra 253B

Gemma 3 27B

37

Nemotron Ultra 253B

41

37
HumanEval
41

Mathematics

Nemotron Ultra 253B

Gemma 3 27B

44

Nemotron Ultra 253B

48

45
AIME 2023
49
47
AIME 2024
51
46
AIME 2025
50
41
HMMT Feb 2023
45
43
HMMT Feb 2024
47
42
HMMT Feb 2025
46
44
BRUMO 2025
48

Reasoning

Nemotron Ultra 253B

Gemma 3 27B

42

Nemotron Ultra 253B

46

43
SimpleQA
47
41
MuSR
45

Frequently Asked Questions

Which is better, Gemma 3 27B or Nemotron Ultra 253B?

Nemotron Ultra 253B scores higher overall with 40 vs 36, a difference of 4 points across all benchmarks.

Which is better for knowledge tasks, Gemma 3 27B or Nemotron Ultra 253B?

Nemotron Ultra 253B leads in knowledge tasks with an average score of 46.8 vs 42.8.

Which is better for coding, Gemma 3 27B or Nemotron Ultra 253B?

Nemotron Ultra 253B leads in coding with an average score of 41 vs 37.

Which is better for math, Gemma 3 27B or Nemotron Ultra 253B?

Nemotron Ultra 253B leads in math with an average score of 48 vs 44.

Which is better for reasoning, Gemma 3 27B or Nemotron Ultra 253B?

Nemotron Ultra 253B leads in reasoning with an average score of 46 vs 42.

Related Comparisons

Gemma 3 27B vs GPT-5.4Gemma 3 27B vs Gemini 3.1 ProGemma 3 27B vs Claude Opus 4.6Gemma 3 27B vs GPT-5.3 CodexGemma 3 27B vs Grok 4.1Gemma 3 27B vs GPT-5.2