Gemini 1.5 Pro vs Grok 4.20 Beta

Side-by-side benchmark comparison across agentic, coding, multimodal, knowledge, reasoning, and math workflows.

Benchmark data for one or both models is coming soon. This page currently shows metadata and pricing where BenchLM has it, and score-level comparisons will populate as public benchmark results land.

BenchLM does not have sourced benchmark coverage for Grok 4.20 Beta yet. This comparison is currently limited to metadata such as context window, reasoning mode, and pricing where available.

Quick Verdict

Benchmark data for Gemini 1.5 Pro and Grok 4.20 Beta is coming soon on BenchLM.

Agentic

Coming soon

Comparable scores for this category are coming soon. One or both models do not have sourced results here yet.

45
Terminal-Bench 2.0
Coming soon
64
BrowseComp
Coming soon
45
OSWorld-Verified
Coming soon

Coding

Coming soon

Comparable scores for this category are coming soon. One or both models do not have sourced results here yet.

56
HumanEval
Coming soon
5
SWE-bench Verified
Coming soon
22
LiveCodeBench
Coming soon
18
SWE-bench Pro
Coming soon

Multimodal & Grounded

Coming soon

Comparable scores for this category are coming soon. One or both models do not have sourced results here yet.

75
MMMU-Pro
Coming soon
73
OfficeQA Pro
Coming soon

Reasoning

Coming soon

Comparable scores for this category are coming soon. One or both models do not have sourced results here yet.

62
SimpleQA
Coming soon
60
MuSR
Coming soon
74
BBH
Coming soon
70
LongBench v2
Coming soon
73
MRCRv2
Coming soon

Knowledge

Coming soon

Comparable scores for this category are coming soon. One or both models do not have sourced results here yet.

64
MMLU
Coming soon
64
GPQA
Coming soon
62
SuperGPQA
Coming soon
60
OpenBookQA
Coming soon
57
MMLU-Pro
Coming soon
1
HLE
Coming soon
54
FrontierScience
Coming soon

Instruction Following

Coming soon

Comparable scores for this category are coming soon. One or both models do not have sourced results here yet.

77
IFEval
Coming soon

Multilingual

Coming soon

Comparable scores for this category are coming soon. One or both models do not have sourced results here yet.

76
MGSM
Coming soon
66
MMLU-ProX
Coming soon

Mathematics

Coming soon

Comparable scores for this category are coming soon. One or both models do not have sourced results here yet.

64
AIME 2023
Coming soon
66
AIME 2024
Coming soon
65
AIME 2025
Coming soon
60
HMMT Feb 2023
Coming soon
62
HMMT Feb 2024
Coming soon
61
HMMT Feb 2025
Coming soon
63
BRUMO 2025
Coming soon
73
MATH-500
Coming soon

Frequently Asked Questions

Can I compare Gemini 1.5 Pro and Grok 4.20 Beta on BenchLM yet?

Not fully yet. BenchLM is tracking both models, but the sourced benchmark breakdown for this comparison is still coming soon.

Why does this comparison show “coming soon”?

BenchLM only shows category winners and benchmark-level calls when we have sourced results that can be compared fairly. For these models, the public benchmark coverage is not complete enough yet.

What data is available for Gemini 1.5 Pro and Grok 4.20 Beta today?

Grok 4.20 Beta: $2.00 input / $6.00 output per 1M tokens Both model pages still include creator, context window, reasoning mode, and other metadata while benchmark coverage fills in.

Last updated: March 12, 2026

Weekly LLM Benchmark Digest

Get notified when new models drop, benchmark scores change, or the leaderboard shifts. One email per week.

Free. No spam. Unsubscribe anytime. We only store derived location metadata for consent routing.