Model comparison
GLM-4.7 vs Nemotron 3 Ultra
Head-to-head evidence from 23 shared benchmark results across 6 categories. Overall scores shown here use the public BenchAlign v5 ranking lane.
Verified leaderboard positions: GLM-4.7 #32; Nemotron 3 Ultra #24
BenchAlign evidence: GLM-4.7 supported; Nemotron 3 Ultra not scored. Intervals and evidence labels describe ranking uncertainty, not a guarantee for a specific workload.
Evidence parity. GLM-4.7 and Nemotron 3 Ultra share 23 comparable benchmark results. 3 of 8 categories are comparable. 8 results are unique to GLM-4.7; 16 to Nemotron 3 Ultra.
Updated July 16, 2026- Shared results
- 23
- GLM-4.7 only
- 8
- Nemotron 3 Ultra only
- 16
- Comparable categories
- 3 / 8
Pick GLM-4.7 if you want the stronger benchmark profile. Nemotron 3 Ultra only becomes the better choice if agentic is the priority or you need the larger 1M context window.
Confidence note. This is a partial-evidence comparison with 23 shared benchmark results across 6 evidence categories; 3 of 8 categories currently have scoreable aggregates for both models. Treat the verdict as directional until coverage is more balanced.
Why this result
GLM-4.7 has the cleaner provisional overall profile here, landing at 62 versus 60. It is a real lead, but still close enough that category-level strengths matter more than the headline number.
GLM-4.7's sharpest advantage is in coding, where it averages 75.4 against 58.3. The single biggest benchmark swing on the page is Terminal-Bench 2.0, 41% to 56.4%. Nemotron 3 Ultra does hit back in agentic, so the answer changes if that is the part of the workload you care about most.
Nemotron 3 Ultra gives you the larger context window at 1M, compared with 200K for GLM-4.7.
Category breakdown
Exact category averages are shown below. Not measured means BenchLM does not have enough sourced public coverage for that model and category.
| Category | GLM-4.7 | Δ | Nemotron 3 Ultra |
|---|---|---|---|
| Coding | GLM-4.775.4 | Margin← 17.1 | Nemotron 3 Ultra58.3 |
| Agentic | GLM-4.745.7 | Margin→ 5.6 | Nemotron 3 Ultra51.3 |
| Knowledge | GLM-4.752.1 | Margin→ 2.1 | Nemotron 3 Ultra54.2 |
| Reasoning | GLM-4.7Not measured | MarginNo overlap | Nemotron 3 Ultra61.9 |
| Math | GLM-4.71.8 | MarginNo overlap | Nemotron 3 UltraNot measured |
| Multilingual | GLM-4.7Not measured | MarginNo overlap | Nemotron 3 Ultra83.0 |
| Inst. Following | GLM-4.7Not measured | MarginNo overlap | Nemotron 3 Ultra81.7 |
Decisive benchmark drivers
The largest measured benchmark gaps in this matchup, with exact reported values.
More
- Source ↗
Terminal-Bench 2.0
AgenticA 41%B 56.4%Winner: Nemotron 3 UltraΔ 15.4Terminal-Bench 2.0: GLM-4.7 scored 41%; Nemotron 3 Ultra scored 56.4%. Nemotron 3 Ultra wins this benchmark. - Source ↗
BrowseComp
AgenticA 52%B 44.4%Winner: GLM-4.7Δ 7.6BrowseComp: GLM-4.7 scored 52%; Nemotron 3 Ultra scored 44.4%. GLM-4.7 wins this benchmark. - Source ↗
MMLU-Pro
KnowledgeA 84.3%B 86.8%Winner: Nemotron 3 UltraΔ 2.5MMLU-Pro: GLM-4.7 scored 84.3%; Nemotron 3 Ultra scored 86.8%. Nemotron 3 Ultra wins this benchmark. - Source ↗
HLE
KnowledgeA 24.8%B 26.7%Winner: Nemotron 3 UltraΔ 1.9HLE: GLM-4.7 scored 24.8%; Nemotron 3 Ultra scored 26.7%. Nemotron 3 Ultra wins this benchmark. - Source ↗
SWE-bench Verified
CodingA 73.8%B 71.9%Winner: GLM-4.7Δ 1.9SWE-bench Verified: GLM-4.7 scored 73.8%; Nemotron 3 Ultra scored 71.9%. GLM-4.7 wins this benchmark.
Operational comparison
Runtime and commercial metrics are compared only when both models have a complete sourced value.
| Metric | GLM-4.7 | Nemotron 3 Ultra | Comparison |
|---|---|---|---|
| Input / output priceUSD per 1M tokens | GLM-4.7$0 input / $0 output | Nemotron 3 Ultra$0 input / $0 output | Listed prices are equal. |
| Generation speedtokens per second | GLM-4.782 tok/s | Nemotron 3 UltraNot available | A complete speed comparison is not available. |
| First-answer latencyseconds to first token | GLM-4.71.10 s | Nemotron 3 UltraNot available | A complete latency comparison is not available. |
| Context windowmaximum listed tokens | GLM-4.7200K | Nemotron 3 Ultra1M | Nemotron 3 Ultra lists the larger context window. |
Benchmark Deep Dive
AgenticNemotron 3 Ultra wins14 benchmarks
| Benchmark | GLM-4.7 | Nemotron 3 Ultra | Result |
|---|---|---|---|
| Terminal-Bench 2.0Source | 41% | 56.4% | Nemotron 3 Ultra leads |
| BrowseCompSource | 52% | 44.4% | GLM-4.7 leads |
| VITA-BenchSource | 15.5% | — | Not comparable |
| AA Agentic IndexSource | 25.4% | 27.4% | Nemotron 3 Ultra leads |
| τ²-bench resultsSource | 95.9% | 83.3% | GLM-4.7 leads |
| Gert LabsSource | 39.95% | — | Not comparable |
| GDPval-AASource | 33.3% | 33.2% | GLM-4.7 leads |
| GDPval-AASource | 1165 | 1164 | GLM-4.7 leads |
| PinchBenchSource | — | 90.0% | Not comparable |
| τ³-bench resultsSource | — | 70.9% | Not comparable |
| HLE w/ toolsSource | — | 37.4% | Not comparable |
| AA BriefcaseSource | — | 870 | Not comparable |
| AA EnterpriseOps-GymSource | — | 28.9% | Not comparable |
| AA Harvey LABSource | — | 3.3% | Not comparable |
CodingGLM-4.7 wins11 benchmarks
| Benchmark | GLM-4.7 | Nemotron 3 Ultra | Result |
|---|---|---|---|
| SWE-bench VerifiedSource | 73.8% | 71.9% | GLM-4.7 leads |
| LiveCodeBenchSource | 84.9% | — | Not comparable |
| SWE-RebenchSource | 58.7% | — | Not comparable |
| AA Coding IndexSource | 45.3% | 49.3% | Nemotron 3 Ultra leads |
| Terminal-Bench HardSource | 31.8% | 36.4% | Nemotron 3 Ultra leads |
| AA-SciCodeSource | 45.1% | 39.9% | GLM-4.7 leads |
| AA LiveCodeBenchSource | 89.4% | — | Not comparable |
| SWE MultilingualSource | — | 67.7% | Not comparable |
| LiveCodeBench v6Source | — | 89.0% | Not comparable |
| SciCodeSource | — | 44.6% | Not comparable |
| Terminal-Bench 2.0Source | — | 56.4% | Not comparable |
Reasoning3 benchmarks
KnowledgeNemotron 3 Ultra wins12 benchmarks
| Benchmark | GLM-4.7 | Nemotron 3 Ultra | Result |
|---|---|---|---|
| GPQASource | 85.7% | 87% | Nemotron 3 Ultra leads |
| MMLU-ProSource | 84.3% | 86.8% | Nemotron 3 Ultra leads |
| HLESource | 24.8% | 26.7% | Nemotron 3 Ultra leads |
| Artificial Analysis Intelligence IndexSource | 33.7% | 37.8% | Nemotron 3 Ultra leads |
| AA-GPQA DiamondSource | 85.9% | 86.7% | Nemotron 3 Ultra leads |
| AA-HLESource | 25.1% | 26.6% | Nemotron 3 Ultra leads |
| AA-Omniscience IndexSource | -34.6% | -0.8% | Nemotron 3 Ultra leads |
| AA-Omniscience AccuracySource | 29.3% | 21.6% | GLM-4.7 leads |
| AA-Omniscience Hallucination RateSource | 90.3% | 28.5% | Nemotron 3 Ultra leads |
| GPQA-DSource | — | 87.0% | Not comparable |
| HLE w/o toolsSource | — | 26.7% | Not comparable |
| AA Openness IndexSource | — | 83.3% | Not comparable |
Math3 benchmarks
Multilingual1 benchmarks
| Benchmark | GLM-4.7 | Nemotron 3 Ultra | Result |
|---|---|---|---|
| MMLU-ProXSource | — | 83% | Not comparable |
Multimodal1 benchmarks
| Benchmark | GLM-4.7 | Nemotron 3 Ultra | Result |
|---|---|---|---|
| Design Arena WebsiteSource | 1260 | 1132 | GLM-4.7 leads |
Frequently Asked Questions (4)
Which is better, GLM-4.7 or Nemotron 3 Ultra?
GLM-4.7 is ahead on BenchLM's provisional leaderboard, 62 to 60. The biggest single separator in this matchup is Terminal-Bench 2.0, where the scores are 41% and 56.4%.
Which is better for knowledge tasks, GLM-4.7 or Nemotron 3 Ultra?
Nemotron 3 Ultra has the edge for knowledge tasks in this comparison, averaging 54.2 versus 52.1. Inside this category, AA-Omniscience Hallucination Rate is the benchmark that creates the most daylight between them.
Which is better for coding, GLM-4.7 or Nemotron 3 Ultra?
GLM-4.7 has the edge for coding in this comparison, averaging 75.4 versus 58.3. Inside this category, AA-SciCode is the benchmark that creates the most daylight between them.
Which is better for agentic tasks, GLM-4.7 or Nemotron 3 Ultra?
Nemotron 3 Ultra has the edge for agentic tasks in this comparison, averaging 51.3 versus 45.7. Inside this category, Terminal-Bench 2.0 is the benchmark that creates the most daylight between them.
Related Comparisons
Explore More
The AI models change fast. We track them for you.
A weekly brief for engineers and researchers covering new models, ranking shifts, and pricing changes.
Free. No spam. Unsubscribe anytime.