Skip to main content
BenchLM
Advertise

Model comparison

Grok 4.20 vs MAI-Thinking-1

Data verified

Head-to-head evidence from 4 shared benchmark results across 3 categories. Overall scores shown here use the public BenchAlign v5 ranking lane.

54.68/100
No comparison
N/A
2 category wins0 category wins

Public leaderboard positions: Grok 4.20 #88 (Estimated); MAI-Thinking-1 unranked (Not scored). Intervals and evidence labels describe ranking uncertainty, not a guarantee for a specific workload.

Evidence parity. Grok 4.20 and MAI-Thinking-1 share 4 comparable benchmark results. 2 of 8 categories are comparable. 14 results are unique to Grok 4.20; 9 to MAI-Thinking-1.

Updated July 23, 2026
Shared results
4
Grok 4.20 only
14
MAI-Thinking-1 only
9
Comparable categories
2 / 8

Treat this as a split decision. Grok 4.20 makes more sense if coding is the priority or you need the larger 2M context window; MAI-Thinking-1 is the better fit if its strengths line up with your actual workload.

Confidence note. This is a partial-evidence comparison with 4 shared benchmark results across 3 evidence categories; 2 of 8 categories currently have scoreable aggregates for both models. Treat the verdict as directional until coverage is more balanced.

Why this result

Grok 4.20 and MAI-Thinking-1 finish on the same BenchAlign overall score, so this is less about a single winner and more about where the edge shows up. The BenchAlign headline says tie; the benchmark table is where the real choice happens.

Grok 4.20 gives you the larger context window at 2M, compared with 256K for MAI-Thinking-1.

Category breakdown

Exact category averages are shown below. Not measured means BenchLM does not have enough sourced public coverage for that model and category.

Category scores and score margins for Grok 4.20 and MAI-Thinking-1
CategoryGrok 4.20ΔMAI-Thinking-1
CodingGrok 4.2067.1Margin← 1.6MAI-Thinking-165.5
AgenticGrok 4.2047.1Margin← 1.1MAI-Thinking-146.0
ReasoningGrok 4.2053.3MarginNo overlapMAI-Thinking-1Not measured
KnowledgeGrok 4.20Not measuredMarginNo overlapMAI-Thinking-172.5
MathGrok 4.20Not measuredMarginNo overlapMAI-Thinking-189.7
MultimodalGrok 4.2070.1MarginNo overlapMAI-Thinking-1Not measured
Inst. FollowingGrok 4.20Not measuredMarginNo overlapMAI-Thinking-185.0

Decisive benchmark drivers

The largest measured benchmark gaps in this matchup, with exact reported values.

More
A · Grok 4.20B · MAI-Thinking-1

  1. SWE-bench Verified

    Coding
    Source ↗
    A 76.7%B 73.5%
    Winner: Grok 4.20Δ 3.2
    SWE-bench Verified: Grok 4.20 scored 76.7%; MAI-Thinking-1 scored 73.5%. Grok 4.20 wins this benchmark.

  2. Terminal-Bench 2.0

    Agentic
    Source ↗
    A 47.1%B 46%
    Winner: Grok 4.20Δ 1.1
    Terminal-Bench 2.0: Grok 4.20 scored 47.1%; MAI-Thinking-1 scored 46%. Grok 4.20 wins this benchmark.

  3. SWE-bench Pro

    Coding
    Source ↗
    A 51.8%B 52.8%
    Winner: MAI-Thinking-1Δ 1
    SWE-bench Pro: Grok 4.20 scored 51.8%; MAI-Thinking-1 scored 52.8%. MAI-Thinking-1 wins this benchmark.

Operational comparison

Runtime and commercial metrics are compared only when both models have a complete sourced value.

MetricGrok 4.20MAI-Thinking-1Comparison
Input / output priceUSD per 1M tokensGrok 4.20$2 input / $6 outputMAI-Thinking-1Not availableA complete price comparison is not available.
Generation speedtokens per secondGrok 4.20233 tok/sMAI-Thinking-1Not availableA complete speed comparison is not available.
First-answer latencyseconds to first tokenGrok 4.2010.33 sMAI-Thinking-1Not availableA complete latency comparison is not available.
Context windowmaximum listed tokensGrok 4.202MMAI-Thinking-1256KGrok 4.20 lists the larger context window.

Benchmark Deep Dive

AgenticGrok 4.20 wins
BenchmarkGrok 4.20MAI-Thinking-1Result
Terminal-Bench 2.0Source 47.1%46%Grok 4.20 leads
DeepSearchQASource 62.8%—Not comparable
Gert LabsSource 38.36%—Not comparable
CodingGrok 4.20 wins
BenchmarkGrok 4.20MAI-Thinking-1Result
LiveCodeBench ProSource 74.2%—Not comparable
SWE-bench VerifiedSource 76.7%73.5%Grok 4.20 leads
SWE-bench ProSource 51.8%52.8%MAI-Thinking-1 leads
Vibe Code BenchSource 4.06%—Not comparable
Terminal-Bench 2.0Source —46.0%Not comparable
Reasoning
BenchmarkGrok 4.20MAI-Thinking-1Result
ARC-AGI-2Source 53.3%—Not comparable
Graphwalks BFS 128KSource —90%Not comparable
Knowledge
BenchmarkGrok 4.20MAI-Thinking-1Result
GPQA-DSource 88.5%84.2%Grok 4.20 leads
HLE w/o toolsSource 31.6%—Not comparable
HealthBench HardSource 20.3%—Not comparable
MedXpertQA (Text)Source 50.2%—Not comparable
GPQASource —84.2%Not comparable
MMLU-ProSource —85%Not comparable
SimpleQASource —31%Not comparable
Math
BenchmarkGrok 4.20MAI-Thinking-1Result
AIME 2025Source —97%Not comparable
AIME26Source —94.5%Not comparable
HMMT Feb 2026Source —84.9%Not comparable
Multimodal
BenchmarkGrok 4.20MAI-Thinking-1Result
MMMU-ProSource 75.2%—Not comparable
CharXivSource 60.9%—Not comparable
ERQASource 54.1%—Not comparable
SimpleVQASource 57.4%—Not comparable
MedXpertQA (MM)Source 65.8%—Not comparable
Design Arena WebsiteSource 1257—Not comparable
Inst. Following
BenchmarkGrok 4.20MAI-Thinking-1Result
IFBenchSource —85%Not comparable
Frequently Asked Questions (3)

Which is better, Grok 4.20 or MAI-Thinking-1?

Grok 4.20 and MAI-Thinking-1 are tied on the BenchAlign overall score, so the right pick depends on which category matters most for your use case.

Which is better for coding, Grok 4.20 or MAI-Thinking-1?

Grok 4.20 has the edge for coding in this comparison, averaging 67.1 versus 65.5. Inside this category, SWE-bench Verified is the benchmark that creates the most daylight between them.

Which is better for agentic tasks, Grok 4.20 or MAI-Thinking-1?

Grok 4.20 has the edge for agentic tasks in this comparison, averaging 47.1 versus 46. Inside this category, Terminal-Bench 2.0 is the benchmark that creates the most daylight between them.

Related Comparisons

Explore More

xAI Compare Pricing Methodology Find Your Best LLM Overall Rankings
Last updated: July 23, 2026

Choose a model with this week’s evidence

Join 2,000+ readers for ranking moves, pricing changes, and the claims that still need proof.

One email each week. Unsubscribe anytime.