Skip to main content

Model comparison

Gemini 3.1 Pro vs GPT-4.1 mini

Data verified

Head-to-head evidence from 18 shared benchmark results across 7 categories. Overall scores shown here use the public BenchAlign v5 ranking lane.

54.7/100
Margin
11.6pts
← winning
43.1/100
1 category wins0 category wins

Public leaderboard positions: Gemini 3.1 Pro #86 (Estimated); GPT-4.1 mini #160 (Estimated). Intervals and evidence labels describe ranking uncertainty, not a guarantee for a specific workload.

Evidence parity. Gemini 3.1 Pro and GPT-4.1 mini share 18 comparable benchmark results. 1 of 8 categories are comparable. 30 results are unique to Gemini 3.1 Pro; 4 to GPT-4.1 mini.

Updated July 24, 2026
Shared results
18
Gemini 3.1 Pro only
30
GPT-4.1 mini only
4
Comparable categories
1 / 8

Pick Gemini 3.1 Pro if you want the stronger benchmark profile. GPT-4.1 mini only becomes the better choice if you want the cheaper token bill.

Confidence note. This is a partial-evidence comparison with 18 shared benchmark results across 7 evidence categories; 1 of 8 categories currently have scoreable aggregates for both models. Treat the verdict as directional until coverage is more balanced.

Why this result

Gemini 3.1 Pro is clearly ahead on the BenchAlign aggregate, 54.7 to 43.1. The gap is large enough that you do not need to squint at the spreadsheet to see the difference.

Gemini 3.1 Pro's sharpest advantage is in mathematics, where it averages 31.8 against 4.5. The single biggest benchmark swing on the page is FrontierMath v2 (Tiers 1-3), 36.900% to 4.483%.

Gemini 3.1 Pro is also the more expensive model on tokens at $2.00 input / $12.00 output per 1M tokens, versus $0.40 input / $1.60 output per 1M tokens for GPT-4.1 mini. That is roughly 7.5x on output cost alone.

Category breakdown

Exact category averages are shown below. Not measured means BenchLM does not have enough sourced public coverage for that model and category.

Category scores and score margins for Gemini 3.1 Pro and GPT-4.1 mini
CategoryGemini 3.1 ProΔGPT-4.1 mini
MathGemini 3.1 Pro31.8Margin 27.3GPT-4.1 mini4.5
CodingGemini 3.1 ProNot measuredMarginNo overlapGPT-4.1 mini23.6
ReasoningGemini 3.1 Pro77.1MarginNo overlapGPT-4.1 miniNot measured
KnowledgeGemini 3.1 ProNot measuredMarginNo overlapGPT-4.1 mini64.2
MultimodalGemini 3.1 Pro82.6MarginNo overlapGPT-4.1 miniNot measured
Inst. FollowingGemini 3.1 ProNot measuredMarginNo overlapGPT-4.1 mini88.5

Decisive benchmark drivers

The largest measured benchmark gaps in this matchup, with exact reported values.

More
A · Gemini 3.1 ProB · GPT-4.1 mini
  1. FrontierMath v2 (Tiers 1-3)

    Math
    Source ↗
    A 36.900%B 4.483%
    Winner: Gemini 3.1 ProΔ 32.4
    FrontierMath v2 (Tiers 1-3): Gemini 3.1 Pro scored 36.900%; GPT-4.1 mini scored 4.483%. Gemini 3.1 Pro wins this benchmark.

Operational comparison

Runtime and commercial metrics are compared only when both models have a complete sourced value.

MetricGemini 3.1 ProGPT-4.1 miniComparison
Input / output priceUSD per 1M tokensGemini 3.1 Pro$2 input / $12 outputGPT-4.1 mini$0.4 input / $1.6 outputGPT-4.1 mini has the lower combined listed price.
Generation speedtokens per secondGemini 3.1 Pro109 tok/sGPT-4.1 mini80 tok/sGemini 3.1 Pro has the higher measured throughput.
First-answer latencyseconds to first tokenGemini 3.1 Pro29.71 sGPT-4.1 mini0.76 sGPT-4.1 mini reaches the first token sooner.
Context windowmaximum listed tokensGemini 3.1 Pro1MGPT-4.1 mini1MListed context windows are equal.

Benchmark Deep Dive

Agentic
BenchmarkGemini 3.1 ProGPT-4.1 miniResult
Claw-EvalSource 57.8%Not comparable
DeepSearchQASource 69.7%Not comparable
τ²-bench resultsSource 95.6%52.9%Gemini 3.1 Pro leads
AA Agentic IndexSource 21.4%1.7%Gemini 3.1 Pro leads
APEX-Agents-AASource 32.0%Not comparable
GDPval-AASource 23.2%0.4%Gemini 3.1 Pro leads
GDPval-AASource 965508Gemini 3.1 Pro leads
Gert LabsSource 56.87%Not comparable
ResearchClawBenchSource 13.3%Not comparable
AA AutomationBenchSource 37.5%Not comparable
AA EnterpriseOps-GymSource 42.2%Not comparable
AA Harvey LABSource 58.9%Not comparable
AA ITBenchSource 30.3%Not comparable
AA Tau3 BankingSource 16.5%Not comparable
terminalBenchHardSource 53.8%Not comparable
aaTerminalBench21Source 73.8%Not comparable
Coding
BenchmarkGemini 3.1 ProGPT-4.1 miniResult
LiveCodeBench ProSource 82.9%Not comparable
React Native EvalsSource 78.9%Not comparable
Vibe Code BenchSource 32.03%Not comparable
AA Coding IndexSource 68.8%20.2%Gemini 3.1 Pro leads
AA-SciCodeSource 58.9%40.4%Gemini 3.1 Pro leads
SWE-bench VerifiedSource 23.6%Not comparable
Reasoning
BenchmarkGemini 3.1 ProGPT-4.1 miniResult
ARC-AGI-2Source 77.1%Not comparable
ARC-AGI-3Source 0.4%Not comparable
AA-LCRSource 72.7%42.3%Gemini 3.1 Pro leads
CritPtSource 17.7%0.0%Gemini 3.1 Pro leads
Knowledge
BenchmarkGemini 3.1 ProGPT-4.1 miniResult
GPQA-DSource 94.3%Not comparable
HLE w/o toolsSource 45.4%Not comparable
HealthBench HardSource 20.6%Not comparable
MedXpertQA (Text)Source 71.5%Not comparable
Artificial Analysis Intelligence IndexSource 46.5%14.8%Gemini 3.1 Pro leads
AA-GPQA DiamondSource 94.1%66.4%Gemini 3.1 Pro leads
AA-HLESource 44.7%4.6%Gemini 3.1 Pro leads
AA-Omniscience IndexSource 32.9%-50.1%Gemini 3.1 Pro leads
AA-Omniscience AccuracySource 55.3%17.5%Gemini 3.1 Pro leads
AA-Omniscience Hallucination RateSource 49.9%82.0%Gemini 3.1 Pro leads
MMLUSource 87.5%Not comparable
GPQASource 64.2%Not comparable
MathGemini 3.1 Pro wins
BenchmarkGemini 3.1 ProGPT-4.1 miniResult
FrontierMath v2 (Tiers 1-3)Source 36.900%4.483%Gemini 3.1 Pro leads
FrontierMath v2 (Tier 4)Source 16.700%Not comparable
Multilingual
BenchmarkGemini 3.1 ProGPT-4.1 miniResult
AA Global-MMLU-LiteSource 93.2%Not comparable
Multimodal
BenchmarkGemini 3.1 ProGPT-4.1 miniResult
MMMU-ProSource 83.9%Not comparable
CharXivSource 80.2%Not comparable
ERQASource 69.4%Not comparable
SimpleVQASource 72.4%Not comparable
ScreenSpot ProSource 84.4%Not comparable
ZeroBenchSource 29.0%Not comparable
MedXpertQA (MM)Source 81.3%Not comparable
AA-MMMU-ProSource 82.4%58.7%Gemini 3.1 Pro leads
Design Arena WebsiteSource 12811027Gemini 3.1 Pro leads
Inst. Following
BenchmarkGemini 3.1 ProGPT-4.1 miniResult
AA-IFBenchSource 77.1%38.3%Gemini 3.1 Pro leads
IFEvalSource 88.5%Not comparable
Frequently Asked Questions (2)

Which is better, Gemini 3.1 Pro or GPT-4.1 mini?

Gemini 3.1 Pro is ahead on BenchLM's BenchAlign leaderboard, 54.7 to 43.1. The biggest single separator in this matchup is FrontierMath v2 (Tiers 1-3), where the scores are 36.900% and 4.483%.

Which is better for math, Gemini 3.1 Pro or GPT-4.1 mini?

Gemini 3.1 Pro has the edge for math in this comparison, averaging 31.8 versus 4.5. Inside this category, FrontierMath v2 (Tiers 1-3) is the benchmark that creates the most daylight between them.

Related Comparisons

Last updated: July 24, 2026