# Grok 4.20 vs MAI-Thinking-1

> Side-by-side benchmark comparison for Grok 4.20 and MAI-Thinking-1 across agentic, coding, multimodal, knowledge, reasoning, multilingual, and math tasks.

- Canonical page: https://benchlm.ai/compare/grok-4-20-beta-vs-mai-thinking-1
- Last updated: September 4, 2026

- Shared sourced benchmarks: 4
- HTML indexing: indexable
- Ranking lane: BenchAlign v5

## Quick Verdict

Pick Grok 4.20 if you want the stronger benchmark profile. MAI-Thinking-1 only makes more sense when its price, context window, or workload-specific category wins matter more than the overall score.

## Summary

- Grok 4.20 leads overall 67.01 to 52.27.
- The clearest category separation is in agentic, where the averages are 26.5 for Grok 4.20 and 51.7 for MAI-Thinking-1.
- The biggest single benchmark swing is GPQA-D in Knowledge, with scores of 88.5% and 84.2%.
- Grok 4.20 also has the larger context window at 2M.

## Model Snapshot

| Property | Grok 4.20 | MAI-Thinking-1 |
|----------|----------|----------|
| Creator | xAI | Microsoft |
| Type | Proprietary | Proprietary |
| Reasoning | Reasoning | Reasoning |
| Context | 2M | 256K |
| Overall Score | 67.01 | 52.27 |
| Benchmarks Covered | 23 | 14 |
| Pricing (input/output) | $2.00 / $6.00 | N/A |

## Category Breakdown

### Agentic

- Winner: Coming soon
- Grok 4.20 public-lane score: 26.5 (Supported · #144/151)
- MAI-Thinking-1 public-lane score: 51.7 (Estimated · #53/151)

| Benchmark | Grok 4.20 | MAI-Thinking-1 | Winner |
|-----------|-----------|-----------|--------|
| Terminal-Bench 2.0 | 47.1% | 46% | Grok 4.20 |
| DeepSearchQA | 62.8% | Coming soon | Coming soon |
| Gert Labs | 38.36% | Coming soon | Coming soon |
| Terminal-Bench 2.1 (Vals) | 44.2% | Coming soon | Coming soon |

### Coding

- Winner: Coming soon
- Grok 4.20 public-lane score: 28.2 (Supported · #171/183)
- MAI-Thinking-1 public-lane score: 51.8 (Estimated · #60/183)

| Benchmark | Grok 4.20 | MAI-Thinking-1 | Winner |
|-----------|-----------|-----------|--------|
| LiveCodeBench Pro | 74.2% | Coming soon | Coming soon |
| SWE-bench Verified | 76.7% | 73.5% | Grok 4.20 |
| SWE-bench Pro | 51.8% | 52.8% | MAI-Thinking-1 |
| Vibe Code Bench | 4.06% | Coming soon | Coming soon |
| LiveCodeBench (Vals) | 84.3% | Coming soon | Coming soon |
| SWE-bench (Vals) | 72.2% | Coming soon | Coming soon |
| LiveCodeBench v6 | Coming soon | 87.7% | Coming soon |
| Terminal-Bench 2.0 | Coming soon | 46.0% | Coming soon |

### Multimodal & Grounded

- Winner: Coming soon
- Grok 4.20 public-lane score: 34.6 (#43/48)
- MAI-Thinking-1 public-lane score: Coming soon

| Benchmark | Grok 4.20 | MAI-Thinking-1 | Winner |
|-----------|-----------|-----------|--------|
| MMMU-Pro | 75.2% | Coming soon | Coming soon |
| CharXiv | 60.9% | Coming soon | Coming soon |
| ERQA | 54.1% | Coming soon | Coming soon |
| SimpleVQA | 57.4% | Coming soon | Coming soon |
| MedXpertQA (MM) | 65.8% | Coming soon | Coming soon |

### Reasoning

- Winner: Coming soon
- Grok 4.20 public-lane score: 34.2 (Unranked · 2 rankable rows)
- MAI-Thinking-1 public-lane score: Coming soon

| Benchmark | Grok 4.20 | MAI-Thinking-1 | Winner |
|-----------|-----------|-----------|--------|
| ARC-AGI-2 | 53.3% | Coming soon | Coming soon |
| ARC-AGI-3 | 0.1% | Coming soon | Coming soon |
| Graphwalks BFS 128K | Coming soon | 90% | Coming soon |

### Knowledge

- Winner: Coming soon
- Grok 4.20 public-lane score: 48.7 (Supported · #97/181)
- MAI-Thinking-1 public-lane score: 53.3 (Estimated · #68/181)

| Benchmark | Grok 4.20 | MAI-Thinking-1 | Winner |
|-----------|-----------|-----------|--------|
| GPQA-D | 88.5% | 84.2% | Grok 4.20 |
| HLE w/o tools | 31.6% | Coming soon | Coming soon |
| HealthBench Hard | 20.3% | Coming soon | Coming soon |
| MedXpertQA (Text) | 50.2% | Coming soon | Coming soon |
| GPQA Diamond (Vals) | 88.6% | Coming soon | Coming soon |
| MMLU-Pro (Vals) | 86.3% | Coming soon | Coming soon |
| GPQA | Coming soon | 84.2% | Coming soon |
| MMLU-Pro | Coming soon | 85% | Coming soon |
| SimpleQA | Coming soon | 31% | Coming soon |

### Instruction Following

- Winner: Coming soon
- Grok 4.20 public-lane score: Coming soon
- MAI-Thinking-1 public-lane score: 94.7 (#1/120)

| Benchmark | Grok 4.20 | MAI-Thinking-1 | Winner |
|-----------|-----------|-----------|--------|
| IFBench | Coming soon | 85% | Coming soon |

### Mathematics

- Winner: Coming soon
- Grok 4.20 public-lane score: Coming soon
- MAI-Thinking-1 public-lane score: 73.4 (Unranked · 3 rankable rows)

| Benchmark | Grok 4.20 | MAI-Thinking-1 | Winner |
|-----------|-----------|-----------|--------|
| AIME 2025 | Coming soon | 97% | Coming soon |
| AIME26 | Coming soon | 94.5% | Coming soon |
| HMMT Feb 2026 | Coming soon | 84.9% | Coming soon |

## FAQ

### Which is better overall, Grok 4.20 or MAI-Thinking-1?

Grok 4.20 is ahead overall on BenchLM right now.

### Where is the biggest gap between Grok 4.20 and MAI-Thinking-1?

The widest category gap is in agentic, where the averages are 26.5 for Grok 4.20 and 51.7 for MAI-Thinking-1.

### How many benchmarks does Grok 4.20 cover on BenchLM?

Grok 4.20 currently has 23 sourced benchmark scores on BenchLM.

### How many benchmarks does MAI-Thinking-1 cover on BenchLM?

MAI-Thinking-1 currently has 14 sourced benchmark scores on BenchLM.

## Related Comparisons

- [Grok 4.20 vs Grok 4.20 Multi-agent](/compare/grok-4-20-beta-vs-grok-4-20-multi-agent-beta)
- [MAI-Thinking-1 vs Grok 4.20 Multi-agent](/compare/grok-4-20-multi-agent-beta-vs-mai-thinking-1)
- [Grok 4.20 vs Claude Fable 5.1](/compare/claude-fable-5-1-vs-grok-4-20-beta)
- [MAI-Thinking-1 vs Claude Fable 5.1](/compare/claude-fable-5-1-vs-mai-thinking-1)

## Explore More

- [Grok 4.20 profile](/models/grok-4-20-beta)
- [MAI-Thinking-1 profile](/models/mai-thinking-1)
- [Compare Pricing](/llm-pricing)
- [Alternative Finder](/tools/alternative-finder)
- [LLM Selector](/tools/llm-selector)
- [Overall Rankings](/best/overall)