Skip to main content

Gemma 3 27B

GoogleEstablishedReleased Mar 12, 2025
Overall Score
Est. 17Prov. #113 of 119
Arena Elo
1365
Categories Ranked
8of 8
Price (1M tokens)
$0 in / $0 out
Speed
31tok/s
Context
32K
Open WeightSelf-hostNon-Reasoning
Confidence
base

According to BenchLM.ai, Gemma 3 27B ranks #113 out of 119 models on the provisional leaderboard with an overall score of 17/100. It does not yet have enough sourced coverage for BenchLM's verified leaderboard. While not a frontier model, it offers specific advantages depending on the use case.

Gemma 3 27B is a open weight model with a 32K token context window. It processes queries without explicit chain-of-thought reasoning, offering faster response times and lower token usage.

This profile currently has 17 of 225 tracked benchmarks. BenchLM only exposes non-generated benchmark rows publicly, so missing categories stay blank until a sourced evaluation is available.

Its strongest category is Mathematics (#77), while its weakest is Multimodal & Grounded (#97). This performance profile makes it particularly strong for mathematical reasoning, scientific computing, and quantitative analysis.

Ranking Distribution

Category rank across 7 benchmark categories — sorted by best rank

Category Performance

Scores across all benchmark categories (0-100 scale)

Category Breakdown

Agentic

#93
12.9/ 100
Weight: 22%4 benchmarks
Terminal-Bench 2.0BrowseCompOSWorld-VerifiedGAIATAU-benchWebArena

Coding

#92
6.0/ 100
Weight: 20%3 benchmarks
SWE-bench VerifiedLiveCodeBenchSWE-bench ProSWE-RebenchSciCode

Reasoning

#82
20.0/ 100
Weight: 17%2 benchmarks
MuSRLongBench v2MRCRv2ARC-AGI-2

Knowledge

#93
16.7/ 100
Weight: 12%6 benchmarks
GPQASuperGPQAMMLU-ProHLEFrontierScienceSimpleQA

Math

#77
13.4/ 100
Weight: 5%0 benchmarks
AIME 2025BRUMO 2025MATH-500FrontierMath

Multilingual

#84
11.1/ 100
Weight: 7%0 benchmarks
MGSMMMLU-ProX

Multimodal

#97
6.8/ 100
Weight: 12%1 benchmark
MMMU-ProOfficeQA ProCharXivCharXiv w/o tools

Inst. Following

#118
0.0/ 100
Weight: 5%1 benchmark
IFEvalIFBench

Chatbot Arena Performance

Text Overall1365

Benchmark Details

Only benchmark rows with an attached exact-source record are shown here. Source-unverified manual rows and generated rows are hidden from model pages.

Frequently Asked Questions

How does Gemma 3 27B perform overall in AI benchmarks?

Gemma 3 27B currently ranks #113 out of 119 models on BenchLM's provisional leaderboard with an overall score of 17 (estimated). It is created by Google and features a 32K context window.

Is Gemma 3 27B good for knowledge and understanding?

Gemma 3 27B ranks #93 out of 119 models in knowledge and understanding benchmarks with an average score of 16.7. There are stronger options in this category.

Is Gemma 3 27B good for coding and programming?

Gemma 3 27B ranks #92 out of 119 models in coding and programming benchmarks with an average score of 6. There are stronger options in this category.

Is Gemma 3 27B good for reasoning and logic?

Gemma 3 27B ranks #82 out of 119 models in reasoning and logic benchmarks with an average score of 20. There are stronger options in this category.

Is Gemma 3 27B good for agentic tool use and computer tasks?

Gemma 3 27B ranks #93 out of 119 models in agentic tool use and computer tasks benchmarks with an average score of 12.9. There are stronger options in this category.

Is Gemma 3 27B good for multimodal and grounded tasks?

Gemma 3 27B ranks #97 out of 119 models in multimodal and grounded tasks benchmarks with an average score of 6.8. There are stronger options in this category.

Is Gemma 3 27B good for instruction following?

Gemma 3 27B ranks #118 out of 119 models in instruction following benchmarks with an average score of 0. There are stronger options in this category.

Is Gemma 3 27B open source?

Yes, Gemma 3 27B is an open weight model created by Google, meaning it can be downloaded and run locally or fine-tuned for specific use cases.

Does Gemma 3 27B have full benchmark coverage on BenchLM?

Not yet. Gemma 3 27B currently has 17 published benchmark scores out of the 225 benchmarks BenchLM tracks. BenchLM only exposes non-generated public benchmark rows, so missing categories stay blank until a sourced evaluation is available.

What is the context window size of Gemma 3 27B?

Gemma 3 27B has a context window of 32K, which determines how much text it can process in a single interaction.

Last updated: June 2, 2026 · Runtime metrics stay blank until BenchLM has a sourced snapshot.

Don't miss the next GPT moment

Which models moved up, what’s new, and what it costs. One email a week, 3-min read.

Free. One email per week.