Model comparison
MiniMax M3 vs Nemotron Ultra 253B
Head-to-head evidence from 12 shared benchmark results across 5 categories. Overall scores shown here use the public BenchAlign v5 ranking lane.
Verified leaderboard positions: MiniMax M3 #18; Nemotron Ultra 253B unranked
BenchAlign evidence: MiniMax M3 supported; Nemotron Ultra 253B estimated. Intervals and evidence labels describe ranking uncertainty, not a guarantee for a specific workload.
Evidence parity. MiniMax M3 and Nemotron Ultra 253B share 12 comparable benchmark results. 0 of 8 categories are comparable. 33 results are unique to MiniMax M3; 0 to Nemotron Ultra 253B.
Updated July 16, 2026- Shared results
- 12
- MiniMax M3 only
- 33
- Nemotron Ultra 253B only
- 0
- Comparable categories
- 0 / 8
Benchmark data for MiniMax M3 and Nemotron Ultra 253B is coming soon on BenchLM.
Confidence note. This is a partial-evidence comparison with 12 shared benchmark results across 5 evidence categories; 0 of 8 categories currently have scoreable aggregates for both models. Treat the verdict as directional until coverage is more balanced.
Why this result
BenchLM has partial data for these models, but not enough overlapping benchmark coverage to produce a fair score-level comparison yet.
MiniMax M3 is priced at $0.30 input / $1.20 output per 1M tokens, versus $0.00 input / $0.00 output per 1M tokens for Nemotron Ultra 253B. MiniMax M3 has the larger context window at 1M, compared with 32K for Nemotron Ultra 253B.
Category breakdown
Exact category averages are shown below. Not measured means BenchLM does not have enough sourced public coverage for that model and category.
| Category | MiniMax M3 | Δ | Nemotron Ultra 253B |
|---|---|---|---|
| Agentic | MiniMax M372.3 | MarginNo overlap | Nemotron Ultra 253BNot measured |
| Coding | MiniMax M372.2 | MarginNo overlap | Nemotron Ultra 253BNot measured |
| Math | MiniMax M385.7 | MarginNo overlap | Nemotron Ultra 253BNot measured |
| Multimodal | MiniMax M364.9 | MarginNo overlap | Nemotron Ultra 253BNot measured |
Operational comparison
Runtime and commercial metrics are compared only when both models have a complete sourced value.
| Metric | MiniMax M3 | Nemotron Ultra 253B | Comparison |
|---|---|---|---|
| Input / output priceUSD per 1M tokens | MiniMax M3$0.3 input / $1.2 output | Nemotron Ultra 253B$0 input / $0 output | Nemotron Ultra 253B has the lower combined listed price. |
| Generation speedtokens per second | MiniMax M3Not available | Nemotron Ultra 253BNot available | A complete speed comparison is not available. |
| First-answer latencyseconds to first token | MiniMax M3Not available | Nemotron Ultra 253BNot available | A complete latency comparison is not available. |
| Context windowmaximum listed tokens | MiniMax M31M | Nemotron Ultra 253B32K | MiniMax M3 lists the larger context window. |
Benchmark Deep Dive
Agentic16 benchmarks
| Benchmark | MiniMax M3 | Nemotron Ultra 253B | Result |
|---|---|---|---|
| Terminal-Bench 2.0Source | 66% | — | Not comparable |
| BrowseCompSource | 83.5% | — | Not comparable |
| OSWorld-VerifiedSource | 70.1% | — | Not comparable |
| MCP AtlasSource | 74.2% | — | Not comparable |
| Claw-EvalSource | 74.5% | — | Not comparable |
| AA Agentic IndexSource | 35.4% | — | Not comparable |
| τ²-bench resultsSource | 88.9% | 11.4% | MiniMax M3 leads |
| GDPval-AASource | 44.7% | — | Not comparable |
| GDPval-AASource | 1395 | — | Not comparable |
| GDPval rubricsSource | 74.7% | — | Not comparable |
| BankerToolBenchSource | 76.1% | — | Not comparable |
| ResearchClawBenchSource | 19.8% | — | Not comparable |
| OSWorld 2.0Source | 4.6% | — | Not comparable |
| AA BriefcaseSource | 1110 | — | Not comparable |
| AA EnterpriseOps-GymSource | 32.1% | — | Not comparable |
| AA Harvey LABSource | 6.7% | — | Not comparable |
Coding11 benchmarks
| Benchmark | MiniMax M3 | Nemotron Ultra 253B | Result |
|---|---|---|---|
| SWE-bench VerifiedSource | 80.5% | — | Not comparable |
| SWE-bench ProSource | 59% | — | Not comparable |
| Terminal-Bench 2.0Source | 66.0% | — | Not comparable |
| NL2RepoSource | 42.1% | — | Not comparable |
| AA Coding IndexSource | 58.6% | — | Not comparable |
| Terminal-Bench HardSource | 42.4% | 2.3% | MiniMax M3 leads |
| AA-SciCodeSource | 45.4% | 34.7% | MiniMax M3 leads |
| VIBE V2Source | 50.1% | — | Not comparable |
| SVG-BenchSource | 63.7% | — | Not comparable |
| KernelBench HardSource | 28.8% | — | Not comparable |
| AA Terminal-Bench 2.1Source | 65.2% | — | Not comparable |
Reasoning2 benchmarks
Knowledge7 benchmarks
| Benchmark | MiniMax M3 | Nemotron Ultra 253B | Result |
|---|---|---|---|
| Artificial Analysis Intelligence IndexSource | 44.4% | 9.1% | MiniMax M3 leads |
| AA-GPQA DiamondSource | 92.9% | 72.8% | MiniMax M3 leads |
| AA-HLESource | 37.1% | 8.1% | MiniMax M3 leads |
| AA-Omniscience IndexSource | 1.4% | -45.5% | MiniMax M3 leads |
| AA-Omniscience AccuracySource | 15.0% | 19.9% | Nemotron Ultra 253B leads |
| AA-Omniscience Hallucination RateSource | 16.1% | 81.7% | MiniMax M3 leads |
| AA Openness IndexSource | 33.3% | — | Not comparable |
Math1 benchmarks
| Benchmark | MiniMax M3 | Nemotron Ultra 253B | Result |
|---|---|---|---|
| USAMO 2026Source | 85.7% | — | Not comparable |
Multimodal7 benchmarks
| Benchmark | MiniMax M3 | Nemotron Ultra 253B | Result |
|---|---|---|---|
| OfficeQA ProSource | 45.1% | — | Not comparable |
| OmniDocBench 1.5Source | 91.6% | — | Not comparable |
| MMMU-ProSource | 78.1% | — | Not comparable |
| VideoMMMUSource | 84.6% | — | Not comparable |
| Video-MME (with subtitle)Source | 85.4% | — | Not comparable |
| Design Arena WebsiteSource | 1294 | — | Not comparable |
| AA-MMMU-ProSource | 78.6% | — | Not comparable |
Inst. Following1 benchmarks
| Benchmark | MiniMax M3 | Nemotron Ultra 253B | Result |
|---|---|---|---|
| AA-IFBenchSource | 82.9% | 38.2% | MiniMax M3 leads |
Frequently Asked Questions (3)
Can I compare MiniMax M3 and Nemotron Ultra 253B on BenchLM yet?
Not fully yet. BenchLM is tracking both models, but the sourced benchmark breakdown for this comparison is still coming soon.
Why does this comparison show “coming soon”?
BenchLM only shows category winners and benchmark-level calls when we have sourced results that can be compared fairly. For these models, the public benchmark coverage is not complete enough yet.
What data is available for MiniMax M3 and Nemotron Ultra 253B today?
MiniMax M3: $0.30 input / $1.20 output per 1M tokens Nemotron Ultra 253B: $0.00 input / $0.00 output per 1M tokens Both model pages still include creator, context window, reasoning mode, and other metadata while benchmark coverage fills in.
Related Comparisons
Explore More
The AI models change fast. We track them for you.
A weekly brief for engineers and researchers covering new models, ranking shifts, and pricing changes.
Free. No spam. Unsubscribe anytime.