o1-preview vs Grok 4.20 Beta

Side-by-side benchmark comparison across agentic, coding, multimodal, knowledge, reasoning, and math workflows.

Benchmark data for one or both models is coming soon. This page currently shows metadata and pricing where BenchLM has it, and score-level comparisons will populate as public benchmark results land.

BenchLM does not have sourced benchmark coverage for Grok 4.20 Beta yet. This comparison is currently limited to metadata such as context window, reasoning mode, and pricing where available.

Grok 4.20 Beta has the larger context window at 2M, compared with 200K for o1-preview.

Quick Verdict

Benchmark data for o1-preview and Grok 4.20 Beta is coming soon on BenchLM.

Agentic

Coming soon

Comparable scores for this category are coming soon. One or both models do not have sourced results here yet.

77
Terminal-Bench 2.0
Coming soon
79
BrowseComp
Coming soon
71
OSWorld-Verified
Coming soon

Coding

Coming soon

Comparable scores for this category are coming soon. One or both models do not have sourced results here yet.

86
HumanEval
Coming soon
65
SWE-bench Verified
Coming soon
60
LiveCodeBench
Coming soon
69
SWE-bench Pro
Coming soon

Multimodal & Grounded

Coming soon

Comparable scores for this category are coming soon. One or both models do not have sourced results here yet.

72
MMMU-Pro
Coming soon
80
OfficeQA Pro
Coming soon

Reasoning

Coming soon

Comparable scores for this category are coming soon. One or both models do not have sourced results here yet.

88
SimpleQA
Coming soon
86
MuSR
Coming soon
93
BBH
Coming soon
87
LongBench v2
Coming soon
83
MRCRv2
Coming soon

Knowledge

Coming soon

Comparable scores for this category are coming soon. One or both models do not have sourced results here yet.

92
MMLU
Coming soon
90
GPQA
Coming soon
88
SuperGPQA
Coming soon
86
OpenBookQA
Coming soon
80
MMLU-Pro
Coming soon
32
HLE
Coming soon
83
FrontierScience
Coming soon

Instruction Following

Coming soon

Comparable scores for this category are coming soon. One or both models do not have sourced results here yet.

88
IFEval
Coming soon

Multilingual

Coming soon

Comparable scores for this category are coming soon. One or both models do not have sourced results here yet.

90
MGSM
Coming soon
86
MMLU-ProX
Coming soon

Mathematics

Coming soon

Comparable scores for this category are coming soon. One or both models do not have sourced results here yet.

94
AIME 2023
Coming soon
96
AIME 2024
Coming soon
95
AIME 2025
Coming soon
90
HMMT Feb 2023
Coming soon
92
HMMT Feb 2024
Coming soon
91
HMMT Feb 2025
Coming soon
93
BRUMO 2025
Coming soon
94
MATH-500
Coming soon

Frequently Asked Questions

Can I compare o1-preview and Grok 4.20 Beta on BenchLM yet?

Not fully yet. BenchLM is tracking both models, but the sourced benchmark breakdown for this comparison is still coming soon.

Why does this comparison show “coming soon”?

BenchLM only shows category winners and benchmark-level calls when we have sourced results that can be compared fairly. For these models, the public benchmark coverage is not complete enough yet.

What data is available for o1-preview and Grok 4.20 Beta today?

Grok 4.20 Beta: $2.00 input / $6.00 output per 1M tokens Both model pages still include creator, context window, reasoning mode, and other metadata while benchmark coverage fills in.

Last updated: March 12, 2026

Weekly LLM Benchmark Digest

Get notified when new models drop, benchmark scores change, or the leaderboard shifts. One email per week.

Free. No spam. Unsubscribe anytime. We only store derived location metadata for consent routing.