Capability
40.4/100
field median 56.2
#171 of 232 ranked models
Every change to the models you run, with its source and its date. Releases, price changes, retirements, API changes, and incidents.Every change to the models you run, with its source.
Follow model changesReleased Jun 4, 2026 — see all recent releases
Data as of September 15, 2026 · How the score is built
Share or export
Multilingual ranks #7. A well-rounded choice across a range of tasks.
24 published rows leave some tracked benchmark slots empty. No comparable first-party API token rate is published.
Each value carries a field reference instead of floating alone. Markers compare this model with the current ranked and priced catalog; they are not absolute quality thresholds.
Capability
40.4/100
field median 56.2
#171 of 232 ranked models
Price
Self-hosted; infrastructure cost varies
input median $0.95
No comparable first-party hosted token rate
Speed
Not measured
field median 91 tok/s
Time to first token not measured
Context
1Mtokens
field median 256,000
Reported for this model; direct source link not stored
Each axis shows percentile within that category’s eligible cohort. The comparison outline is the median of the six nearest public-score peers; a collapsed vertex means the category is not rank-eligible.
Nemotron 3 Ultra category percentile values
The dashed outline is median of 6 nearest peers.
Coverage is split by category so a strong number never hides a thin evidence base. Verified means the row is tied to a published source; provisional rows remain visible but separate.
Each documented value carries its source. Missing fields stay visible as not sourced or not published, rather than disappearing from the page.
Self-host and provider-specific paths stay separate from benchmark evidence so operating constraints are visible before a score becomes the whole decision.
Published weights are available, but BenchLM does not yet have a sourced parameter and VRAM profile for this exact model. Hardware cost estimates stay unavailable until that sizing record is complete.
Estimate VRAM from known parametersScores and ranks appear only where published evidence can be displayed. The table keeps the score, weight, cohort, and evidence state together.
| Category | Score | Rank | Percentile | Weight | Benchmarks | Evidence |
|---|---|---|---|---|---|---|
| AgenticRank #144 of 153Percentile 6thWeight 22%6 benchmarksVerified | 26.9 | #144 of 153 | 6th | 22% | 6 benchmarks | Verified |
| CodingRank #146 of 152Percentile 4thWeight 20%7 benchmarksVerified | 26.6 | #146 of 152 | 4th | 20% | 7 benchmarks | Verified |
| ReasoningRank Not rankedWeight 17%2 benchmarksVerified | 48.7 | Not ranked | Not available | 17% | 2 benchmarks | Verified |
| KnowledgeRank #112 of 183Percentile 39thWeight 12%7 benchmarksVerified | 44.7 | #112 of 183 | 39th | 12% | 7 benchmarks | Verified |
| MathWeight 5%0 benchmarksNot measured | Not measured | Not ranked | Not available | 5% | 0 benchmarks | Not measured |
| MultilingualRank #7 of 12Percentile 45thWeight 7%1 benchmarkVerified | 47.4 | #7 of 12 | 45th | 7% | 1 benchmark | Verified |
| MultimodalWeight 12%0 benchmarksNot measured | Not measured | Not ranked | Not available | 12% | 0 benchmarks | Not measured |
| Inst. FollowingRank #28 of 123Percentile 78thWeight 5%1 benchmarkVerified | 88.8 | #28 of 123 | 78th | 5% | 1 benchmark | Verified |
Coding opens by default. The marker compares each value with the best source-verified result in the catalog; provisional leaders do not set the reference. Expand the remaining categories for every published row.
| Benchmark | Score | Versus best verified row | Gap | Weight | Evidence |
|---|---|---|---|---|---|
| LiveCodeBench (Vals)LiveCodeBench, Vals AI run | Score86.0% | Versus best verified row Best verified: Claude Fable 5.1 · 90.5% | Gap4.5 behind | WeightWeighted 15% | |
| SWE-bench VerifiedSoftware Engineering Benchmark Verified | Score71.9% | Versus best verified row Best verified: Claude Opus 5 · 96% | Gap24.1 behind | WeightWeighted 10% | Provider exact |
| SciCodeScientific Code Benchmark | Score44.6% | Versus best verified row Best verified: Sakana Fugu · 60.1% | Gap15.5 behind | WeightWeighted 10% | Provider exact |
| SWE Multilingual | Score67.7% | Versus best verified row Best verified: Claude Opus 5 · 89.5% | Gap21.8 behind | WeightWeighted 5% | Provider exact |
| LiveCodeBench v6 | Score89.0% | Versus best verified row Best verified: Sakana Fugu-Ultra · 93.2% | Gap4.2 behind | WeightDisplay only | Provider exact |
| Terminal-Bench 2.0 | Score56.4% | Versus best verified row Best verified: GPT-5.6 Sol · 91.9% | Gap35.5 behind | WeightDisplay only | Provider exact |
| SWE-bench (Vals)SWE-bench, Vals AI run | Score69.0% | Versus best verified row Best verified: Claude Opus 5 · 97.0% | Gap28 behind | WeightDisplay only | Verified |
| Benchmark | Score | Versus best verified row | Gap | Weight | Evidence |
|---|---|---|---|---|---|
| Terminal-Bench 2.0 | Score56.4% | Versus best verified row Best verified: GPT-5.6 Sol · 91.9% | Gap35.5 behind | WeightWeighted 30% | Provider exact |
| BrowseComp | Score44.4% | Versus best verified row Best verified: Atria Dawn Preview · 92.5% | Gap48.1 behind | WeightWeighted 25% | Provider exact |
| PinchBench | Score90.0% | Versus best verified row Best verified: Pokee-Isaac 28B · 95.7% | Gap5.7 behind | WeightDisplay only | Provider exact |
| τ³-bench resultsτ³-Bench Tool-Agent-User Evaluation | Score70.9% | Versus best verified row Best verified: Mercury 2.5 · 96.0% | Gap25.1 behind | WeightDisplay only | Provider exact |
| HLE w/ toolsHumanity's Last Exam with tools | Score37.4% | Versus best verified row Best verified: Claude Opus 5 · 64.7% | Gap27.3 behind | WeightDisplay only | Provider exact |
| Terminal-Bench 2.1 (Vals)Terminal-Bench 2.1, Vals AI run | Score50.9% | Versus best verified row Best verified: GPT-6 Astra · 87.3% | Gap36.4 behind | WeightDisplay only |
| Benchmark | Score | Versus best verified row | Gap | Weight | Evidence |
|---|---|---|---|---|---|
| LongBench v2 | Score61.9% | Versus best verified row Best verified: Qwen3.8 Max · 66.3% | Gap4.4 behind | WeightWeighted 25% | Provider exact |
| CritPtCritical Physics Tasks | Score3.1% | Versus best verified row Best verified: GPT-6 Astra · 31.7% | Gap28.6 behind | WeightDisplay only | Provider exact |
| Benchmark | Score | Versus best verified row | Gap | Weight | Evidence |
|---|---|---|---|---|---|
| HLEHumanity's Last Exam | Score26.7% | Versus best verified row Best verified: Claude Fable 5.1 · 65% | Gap38.3 behind | WeightWeighted 35% | Provider exact |
| MMLU-ProMassive Multitask Language Understanding Professional | Score86.8% | Versus best verified row Best verified: Qwen3.7 Max · 89.6% | Gap2.8 behind | WeightWeighted 20% | Provider exact |
| HLE w/o toolsHumanity's Last Exam without tools | Score26.7% | Versus best verified row Best verified: Claude Fable 5.1 · 60.9% | Gap34.2 behind | WeightWeighted 10% | Provider exact |
| MMLU-Pro (Vals)MMLU-Pro, Vals AI run | Score85.8% | Versus best verified row Best verified: Claude Fable 5.1 · 92.4% | Gap6.6 behind | WeightWeighted 10% | Verified |
| GPQAGraduate-Level Google-Proof Q&A | Score87% | Versus best verified row Best verified: GPT-6 Astra · 96% | Gap9 behind | WeightWeighted 7% | Provider exact |
| GPQA-DGPQA Diamond | Score87.0% | Versus best verified row Best verified: GPT-6 Astra · 96.0% | Gap9 behind | WeightDisplay only | Provider exact |
| GPQA Diamond (Vals)GPQA Diamond, Vals AI run | Score86.1% | Versus best verified row Best verified: Gemini 3.1 Pro · 95.5% | Gap9.4 behind | WeightDisplay only |
| Benchmark | Score | Versus best verified row | Gap | Weight | Evidence |
|---|---|---|---|---|---|
| MMLU-ProX | Score83% | Versus best verified row Best verified: Qwen3.7 Max · 87% | Gap4 behind | WeightWeighted 100% | Provider exact |
| Benchmark | Score | Versus best verified row | Gap | Weight | Evidence |
|---|---|---|---|---|---|
| IFBenchInstruction Following Benchmark | Score81.7% | Versus best verified row Best verified: MAI-Thinking-1 · 85% | Gap3.3 behind | WeightWeighted 70% | Provider exact |
The sequence follows explicit supersedes links. A successor's displayed score stays at least 0.1 points above its predecessor; raw benchmark rows do not move. Scores and prices remain blank when the corresponding public row or first-party rate is unavailable.
Jun 4, 2026 · you are here
Nemotron 3 UltraScore 40.4 · Price not listed
Base entry
The visual layer above carries the decisions. These notes preserve the model, ranking, coverage, and family context behind the numbers.
Nemotron 3 Ultra ranks #171 of 232 on the public leaderboard with a score of 40.39/100. It does not yet have enough sourced coverage for a verified position.
Nemotron 3 Ultra is a open weight model with a 1M context window. It uses an explicit reasoning mode, which can improve complex problem solving while adding latency and token use.
Official exact-value snapshot from the nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 Hugging Face model card. BenchLM maps directly comparable values from NVIDIA's table and keeps provider-specific rows display-only where appropriate. NVIDIA's earlier announcement used approximate 500B/50B wording; the released checkpoint is 550B total / 55B active.
24 of 439 tracked benchmark slots currently have displayable evidence. Missing categories stay blank.
Its strongest eligible category is Multilingual at #7, while its lowest eligible position is Coding at #146. a well-rounded choice across a range of tasks.
NVIDIA · Model release
Radar confirmed these at the source. Use Nemotron 3 Ultra in your work? Explore Radar to follow supported changes and choose your alerts.
Nemotron 3 Ultra ranks #171 out of 232 models on the public BenchAlign leaderboard, with a score of 40.39/100. Its evidence status is Estimated, and this profile shows 24 source-displayable benchmark rows. The label describes evidence depth, not a provider quality claim; inspect category rows before choosing a workload.
Nemotron 3 Ultra ranks #112 out of 183 eligible models for knowledge and understanding, with a public category score of 44.7/100. Higher-ranked alternatives are available for workloads where this category decides the choice. Check the underlying rows before treating the aggregate as a workload guarantee.
Nemotron 3 Ultra ranks #146 out of 152 eligible models for coding and programming, with a public category score of 26.6/100. Higher-ranked alternatives are available for workloads where this category decides the choice. Check the underlying rows before treating the aggregate as a workload guarantee.
Nemotron 3 Ultra has source-displayable benchmark coverage for reasoning and logic, but the public category table does not assign it a rank there. The individual rows remain available for inspection. A missing category position means the evidence threshold was not met; it does not convert the model's unmeasured work into a zero.
Nemotron 3 Ultra ranks #144 out of 153 eligible models for agentic tool use and computer tasks, with a public category score of 26.9/100. Higher-ranked alternatives are available for workloads where this category decides the choice. Check the underlying rows before treating the aggregate as a workload guarantee.
Nemotron 3 Ultra ranks #28 out of 123 eligible models for instruction following, with a public category score of 88.8/100. Higher-ranked alternatives are available for workloads where this category decides the choice. Check the underlying rows before treating the aggregate as a workload guarantee.
Nemotron 3 Ultra ranks #7 out of 12 eligible models for multilingual tasks, with a public category score of 47.4/100. That places it in the current top ten for this category. Check the underlying rows before treating the aggregate as a workload guarantee.
Nemotron 3 Ultra is an open-weight model from NVIDIA. Its weights can be downloaded for local or hosted deployment, subject to the published license. Open weight does not automatically mean open source: training data and training code may remain private, and commercial restrictions can still apply.
No. Nemotron 3 Ultra currently has 43 source-displayable rows across 439 tracked benchmark slots. The profile exposes published, non-generated evidence and leaves missing categories blank until an exact evaluation is available. Coverage describes how much was measured; it is not a penalty added to an individual benchmark result.
Nemotron 3 Ultra has a reported context window of 1M in the exact-model catalog record. The value stays visible, but the profile marks its source link as unavailable instead of presenting it as directly documented. Maximum output length remains separate because providers often publish a different limit.
Related resources
Last updated September 15, 2026. Runtime fields remain blank until a sourced snapshot exists.
Get one weekly email when material rank, price, availability, or benchmark evidence changes are worth revisiting.
Read a sample issueJoin 2,000+ readers.