Skip to main content

Model comparison

Gemma 3 27B vs Inkling

Data verified

Head-to-head evidence from 14 shared benchmark results across 5 categories. Overall scores shown here use the public BenchAlign v5 ranking lane.

41.41/100
Margin
30.6pts
winning →
Thinking Machines Lab
72/100
0 category wins0 category wins

Verified leaderboard positions: Gemma 3 27B unranked; Inkling #17

BenchAlign evidence: Gemma 3 27B supported; Inkling not scored. Intervals and evidence labels describe ranking uncertainty, not a guarantee for a specific workload.

Evidence parity. Gemma 3 27B and Inkling share 14 comparable benchmark results. 0 of 8 categories are comparable. 3 results are unique to Gemma 3 27B; 18 to Inkling.

Updated July 16, 2026
Shared results
14
Gemma 3 27B only
3
Inkling only
18
Comparable categories
0 / 8

Benchmark data for Gemma 3 27B and Inkling is coming soon on BenchLM.

Confidence note. This is a partial-evidence comparison with 14 shared benchmark results across 5 evidence categories; 0 of 8 categories currently have scoreable aggregates for both models. Treat the verdict as directional until coverage is more balanced.

Why this result

BenchLM has partial data for these models, but not enough overlapping benchmark coverage to produce a fair score-level comparison yet.

Inkling is priced at $1.87 input / $4.68 output per 1M tokens, versus $0.00 input / $0.00 output per 1M tokens for Gemma 3 27B. Inkling has the larger context window at 1M, compared with 32K for Gemma 3 27B.

Category breakdown

Exact category averages are shown below. Not measured means BenchLM does not have enough sourced public coverage for that model and category.

Category scores and score margins for Gemma 3 27B and Inkling
CategoryGemma 3 27BΔInkling
AgenticGemma 3 27BNot measuredMarginNo overlapInkling69.4
CodingGemma 3 27BNot measuredMarginNo overlapInkling68.6
KnowledgeGemma 3 27BNot measuredMarginNo overlapInkling51.7
MathGemma 3 27BNot measuredMarginNo overlapInkling97.1
MultimodalGemma 3 27BNot measuredMarginNo overlapInkling76.5
Inst. FollowingGemma 3 27BNot measuredMarginNo overlapInkling79.8

Operational comparison

Runtime and commercial metrics are compared only when both models have a complete sourced value.

MetricGemma 3 27BInklingComparison
Input / output priceUSD per 1M tokensGemma 3 27B$0 input / $0 outputInkling$1.87 input / $4.68 outputGemma 3 27B has the lower combined listed price.
Generation speedtokens per secondGemma 3 27B31 tok/sInklingNot availableA complete speed comparison is not available.
First-answer latencyseconds to first tokenGemma 3 27B2.04 sInklingNot availableA complete latency comparison is not available.
Context windowmaximum listed tokensGemma 3 27B32KInkling1MInkling lists the larger context window.

Benchmark Deep Dive

Agentic
BenchmarkGemma 3 27BInklingResult
AA Agentic IndexSource 0.3%32.3%Inkling leads
τ²-bench resultsSource 10.5%Not comparable
GDPval-AASource 0.0%36.9%Inkling leads
GDPval-AASource -1441239Inkling leads
Terminal-Bench 2.0Source 63.8%Not comparable
BrowseCompSource 77.1%Not comparable
MCP AtlasSource 74.1%Not comparable
Design Arena Agentic Web DevSource 1258Not comparable
AA BriefcaseSource 836Not comparable
AA Tau3 BankingSource 23.7%Not comparable
Coding
BenchmarkGemma 3 27BInklingResult
AA Coding IndexSource 10.1%52.1%Inkling leads
Terminal-Bench HardSource 3.8%Not comparable
AA-SciCodeSource 21.2%46.1%Inkling leads
SWE-bench VerifiedSource 77.6%Not comparable
SWE-bench ProSource 54.3%Not comparable
Terminal-Bench 2.0Source 63.8%Not comparable
Reasoning
BenchmarkGemma 3 27BInklingResult
AA-LCRSource 5.7%63.3%Inkling leads
CritPtSource 0.0%5.4%Inkling leads
Knowledge
BenchmarkGemma 3 27BInklingResult
Artificial Analysis Intelligence IndexSource 7.4%40.7%Inkling leads
AA-GPQA DiamondSource 42.8%87.2%Inkling leads
AA-HLESource 4.7%29.7%Inkling leads
AA-Omniscience IndexSource -65.9%2.1%Inkling leads
AA-Omniscience AccuracySource 12.5%40.0%Inkling leads
AA-Omniscience Hallucination RateSource 89.5%63.1%Inkling leads
GPQASource 87.9%Not comparable
GPQA-DSource 87.9%Not comparable
HLESource 46%Not comparable
HLE w/o toolsSource 30%Not comparable
Math
BenchmarkGemma 3 27BInklingResult
AIME26Source 97.1%Not comparable
Multimodal
BenchmarkGemma 3 27BInklingResult
AA-MMMU-ProSource 48.0%73.5%Inkling leads
MMMU-ProSource 73.5%Not comparable
CharXivSource 82%Not comparable
CharXiv w/o toolsSource 78.1%Not comparable
Inst. Following
BenchmarkGemma 3 27BInklingResult
AA-IFBenchSource 31.8%Not comparable
IFBenchSource 79.8%Not comparable
Frequently Asked Questions (3)

Can I compare Gemma 3 27B and Inkling on BenchLM yet?

Not fully yet. BenchLM is tracking both models, but the sourced benchmark breakdown for this comparison is still coming soon.

Why does this comparison show “coming soon”?

BenchLM only shows category winners and benchmark-level calls when we have sourced results that can be compared fairly. For these models, the public benchmark coverage is not complete enough yet.

What data is available for Gemma 3 27B and Inkling today?

Gemma 3 27B: $0.00 input / $0.00 output per 1M tokens Inkling: $1.87 input / $4.68 output per 1M tokens Both model pages still include creator, context window, reasoning mode, and other metadata while benchmark coverage fills in.

Related Comparisons

Last updated: July 16, 2026

The AI models change fast. We track them for you.

A weekly brief for engineers and researchers covering new models, ranking shifts, and pricing changes.

Free. No spam. Unsubscribe anytime.