Skip to main content
BenchLM
Advertise

Model comparison

MiniCPM5-1B vs Nemotron 3 Ultra

Data verified

Head-to-head evidence from 4 shared benchmark results across 3 categories. Overall scores shown here use the public BenchAlign v5 ranking lane.

36/100
Margin
24.0pts
winning →
60/100
0 category wins2 category wins

Verified leaderboard positions: MiniCPM5-1B unranked; Nemotron 3 Ultra #24

Evidence parity. MiniCPM5-1B and Nemotron 3 Ultra share 4 comparable benchmark results. 2 of 8 categories are comparable. 10 results are unique to MiniCPM5-1B; 35 to Nemotron 3 Ultra.

Updated July 16, 2026
Shared results
4
MiniCPM5-1B only
10
Nemotron 3 Ultra only
35
Comparable categories
2 / 8

Pick Nemotron 3 Ultra if you want the stronger benchmark profile. MiniCPM5-1B only becomes the better choice if its workflow or ecosystem matters more than the raw scoreboard.

Confidence note. This is a partial-evidence comparison with 4 shared benchmark results across 3 evidence categories; 2 of 8 categories currently have scoreable aggregates for both models. Treat the verdict as directional until coverage is more balanced.

Why this result

Nemotron 3 Ultra is clearly ahead on the provisional aggregate, 60 to 36. The gap is large enough that you do not need to squint at the spreadsheet to see the difference.

Nemotron 3 Ultra's sharpest advantage is in instruction following, where it averages 81.7 against 58.5. The single biggest benchmark swing on the page is MMLU-Pro, 48.9% to 86.8%.

Nemotron 3 Ultra gives you the larger context window at 1M, compared with 131K for MiniCPM5-1B.

Category breakdown

Exact category averages are shown below. Not measured means BenchLM does not have enough sourced public coverage for that model and category.

Category scores and score margins for MiniCPM5-1B and Nemotron 3 Ultra
CategoryMiniCPM5-1BΔNemotron 3 Ultra
Inst. FollowingMiniCPM5-1B58.5Margin→ 23.2Nemotron 3 Ultra81.7
KnowledgeMiniCPM5-1B44.1Margin→ 10.1Nemotron 3 Ultra54.2
AgenticMiniCPM5-1BNot measuredMarginNo overlapNemotron 3 Ultra51.3
CodingMiniCPM5-1BNot measuredMarginNo overlapNemotron 3 Ultra58.3
ReasoningMiniCPM5-1BNot measuredMarginNo overlapNemotron 3 Ultra61.9
MathMiniCPM5-1B33.1MarginNo overlapNemotron 3 UltraNot measured
MultilingualMiniCPM5-1BNot measuredMarginNo overlapNemotron 3 Ultra83.0

Decisive benchmark drivers

The largest measured benchmark gaps in this matchup, with exact reported values.

More
A · MiniCPM5-1BB · Nemotron 3 Ultra

  1. MMLU-Pro

    Knowledge
    Source ↗
    A 48.9%B 86.8%
    Winner: Nemotron 3 UltraΔ 37.9
    MMLU-Pro: MiniCPM5-1B scored 48.9%; Nemotron 3 Ultra scored 86.8%. Nemotron 3 Ultra wins this benchmark.

  2. IFBench

    Inst. Following
    Source ↗
    A 46.7%B 81.7%
    Winner: Nemotron 3 UltraΔ 35
    IFBench: MiniCPM5-1B scored 46.7%; Nemotron 3 Ultra scored 81.7%. Nemotron 3 Ultra wins this benchmark.

Operational comparison

Runtime and commercial metrics are compared only when both models have a complete sourced value.

MetricMiniCPM5-1BNemotron 3 UltraComparison
Input / output priceUSD per 1M tokensMiniCPM5-1BNot availableNemotron 3 Ultra$0 input / $0 outputA complete price comparison is not available.
Generation speedtokens per secondMiniCPM5-1BNot availableNemotron 3 UltraNot availableA complete speed comparison is not available.
First-answer latencyseconds to first tokenMiniCPM5-1BNot availableNemotron 3 UltraNot availableA complete latency comparison is not available.
Context windowmaximum listed tokensMiniCPM5-1B131KNemotron 3 Ultra1MNemotron 3 Ultra lists the larger context window.

Benchmark Deep Dive

Agentic
BenchmarkMiniCPM5-1BNemotron 3 UltraResult
BFCL v4Source 25.1%—Not comparable
Terminal-Bench 2.0Source —56.4%Not comparable
PinchBenchSource —90.0%Not comparable
BrowseCompSource —44.4%Not comparable
τ³-bench resultsSource —70.9%Not comparable
GDPval-AASource —33.2%Not comparable
HLE w/ toolsSource —37.4%Not comparable
AA Agentic IndexSource —27.4%Not comparable
τ²-bench resultsSource —83.3%Not comparable
GDPval-AASource —1164Not comparable
AA BriefcaseSource —870Not comparable
AA EnterpriseOps-GymSource —28.9%Not comparable
AA Harvey LABSource —3.3%Not comparable
Coding
BenchmarkMiniCPM5-1BNemotron 3 UltraResult
LiveCodeBench ProSource 22.7%—Not comparable
LiveCodeBench v6Source 33.5%89.0%Nemotron 3 Ultra leads
SWE-bench VerifiedSource —71.9%Not comparable
SWE MultilingualSource —67.7%Not comparable
SciCodeSource —44.6%Not comparable
Terminal-Bench 2.0Source —56.4%Not comparable
AA Coding IndexSource —49.3%Not comparable
Terminal-Bench HardSource —36.4%Not comparable
AA-SciCodeSource —39.9%Not comparable
Reasoning
BenchmarkMiniCPM5-1BNemotron 3 UltraResult
BBHSource 71.9%—Not comparable
AA-LCRSource —67.0%Not comparable
CritPtSource —3.1%Not comparable
LongBench v2Source —61.9%Not comparable
KnowledgeNemotron 3 Ultra wins
BenchmarkMiniCPM5-1BNemotron 3 UltraResult
MMLU-ProSource 48.9%86.8%Nemotron 3 Ultra leads
MMLU-ReduxSource 70.1%—Not comparable
GPQA-DSource 26.3%87.0%Nemotron 3 Ultra leads
SuperGPQASource 23.1%—Not comparable
GPQASource —87%Not comparable
HLESource —26.7%Not comparable
HLE w/o toolsSource —26.7%Not comparable
AA-Omniscience AccuracySource —21.6%Not comparable
Artificial Analysis Intelligence IndexSource —37.8%Not comparable
AA-GPQA DiamondSource —86.7%Not comparable
AA-HLESource —26.6%Not comparable
AA-Omniscience IndexSource —-0.8%Not comparable
AA-Omniscience Hallucination RateSource —28.5%Not comparable
AA Openness IndexSource —83.3%Not comparable
Math
BenchmarkMiniCPM5-1BNemotron 3 UltraResult
AIME 2025Source 40.4%—Not comparable
AIME26Source 40.4%—Not comparable
HMMT Feb 2026Source 25.8%—Not comparable
MATH-500Source 91.6%—Not comparable
Multilingual
BenchmarkMiniCPM5-1BNemotron 3 UltraResult
MMLU-ProXSource —83%Not comparable
Multimodal
BenchmarkMiniCPM5-1BNemotron 3 UltraResult
Design Arena WebsiteSource —1132Not comparable
Inst. FollowingNemotron 3 Ultra wins
BenchmarkMiniCPM5-1BNemotron 3 UltraResult
IFBenchSource 46.7%81.7%Nemotron 3 Ultra leads
IFEvalSource 80.4%—Not comparable
AA-IFBenchSource —81.4%Not comparable
Frequently Asked Questions (3)

Which is better, MiniCPM5-1B or Nemotron 3 Ultra?

Nemotron 3 Ultra is ahead on BenchLM's provisional leaderboard, 60 to 36. The biggest single separator in this matchup is MMLU-Pro, where the scores are 48.9% and 86.8%.

Which is better for knowledge tasks, MiniCPM5-1B or Nemotron 3 Ultra?

Nemotron 3 Ultra has the edge for knowledge tasks in this comparison, averaging 54.2 versus 44.1. Inside this category, GPQA-D is the benchmark that creates the most daylight between them.

Which is better for instruction following, MiniCPM5-1B or Nemotron 3 Ultra?

Nemotron 3 Ultra has the edge for instruction following in this comparison, averaging 81.7 versus 58.5. Inside this category, IFBench is the benchmark that creates the most daylight between them.

Related Comparisons

Explore More

OpenBMB Compare Pricing Methodology Find Your Best LLM Overall Rankings
Last updated: July 16, 2026

The AI models change fast. We track them for you.

A weekly brief for engineers and researchers covering new models, ranking shifts, and pricing changes.

Free. No spam. Unsubscribe anytime.