Model profile
Gemma 3 27B
Evidence coverage
16 of 321 tracked benchmarks are published. 0 are verified and 16 provisional. 6 of 8 categories are measured.
- Published / tracked
- 16 / 321
- Verified
- 0
- Provisional
- 16
- Categories with evidence
- 6 / 8
Evidence by category
- Agentic4 benchmarksReported
- Coding2 benchmarksReported
- Reasoning2 benchmarksReported
- Knowledge6 benchmarksReported
- Math0 benchmarksNot measured
- Multilingual0 benchmarksNot measured
- Multimodal1 benchmarkReported
- Inst. Following1 benchmarkReported
Gemma 3 27B ranks #164 out of 200 models on the public leaderboard with an overall score of 41.57/100. It also ranks #76 out of 99 on the verified leaderboard. While not a frontier model, it offers specific advantages depending on the use case.
Gemma 3 27B is a open weight model with a 32K token context window. It processes queries without explicit chain-of-thought reasoning, offering faster response times and lower token usage.
This profile currently has 16 of 321 tracked benchmarks. BenchLM only exposes non-generated benchmark rows publicly, so missing categories stay blank until a sourced evaluation is available.
Its strongest category is Agentic (#105), while its weakest is Coding (#108). This performance profile makes it particularly useful for coding agents, browser research, and computer-use workflows.
Peer position
Exact provisional scores and ranks for the closest listed peers. A score can appear before a model clears the evidence threshold for a rank, so equal scores can have different rank states.
Range 41.13–42.06
- GPT-4.1 nanoOpenAICompare#16142.06GPT-4.1 nano is #161 with a score of 42.06.
- Gemma 4 E2BGoogleCompare#16241.82Gemma 4 E2B is #162 with a score of 41.82.
- Mistral Large 2MistralCompare#16341.77Mistral Large 2 is #163 with a score of 41.77.
- Gemma 3 27BCurrent modelGoogle#16441.57Gemma 3 27B is #164 with a score of 41.57.
- GPT-4oOpenAICompare#16541.49GPT-4o is #165 with a score of 41.49.
- LFM2.5-8B-A1BLiquidAICompare#16641.42LFM2.5-8B-A1B is #166 with a score of 41.42.
- Claude 3 OpusAnthropicCompare#16841.13Claude 3 Opus is #168 with a score of 41.13.
Category percentile
More
Relative position among models eligible for each sourced category. A higher percentile means a stronger position within that category's ranked cohort; 100 is highest.
- Agentic12%Eligible cohort rank #105 of 119Category score 35.9
- Coding12%Eligible cohort rank #108 of 122Category score 37.8
Category evidence
Scores and ranks appear only where this model has published benchmark evidence. Categories without displayable source records remain not measured.
| Category | Score | Rank | Percentile | Weight | Benchmarks | Evidence |
|---|---|---|---|---|---|---|
| AgenticRank #105 of 119Percentile 12thWeight 22%4 benchmarksReported | 35.9 | #105 of 119 | 12th | 22% | 4 benchmarks | Reported |
| CodingRank #108 of 122Percentile 12thWeight 20%2 benchmarksReported | 37.8 | #108 of 122 | 12th | 20% | 2 benchmarks | Reported |
| ReasoningRank Not rankedWeight 17%2 benchmarksReported | 45.7 | Not ranked | Not available | 17% | 2 benchmarks | Reported |
| KnowledgeRank Not rankedWeight 12%6 benchmarksReported | 17.3 | Not ranked | Not available | 12% | 6 benchmarks | Reported |
| MathWeight 5%0 benchmarksNot measured | Not measured | Not ranked | Not available | 5% | 0 benchmarks | Not measured |
| MultilingualWeight 7%0 benchmarksNot measured | Not measured | Not ranked | Not available | 7% | 0 benchmarks | Not measured |
| MultimodalRank Not rankedWeight 12%1 benchmarkReported | 41.4 | Not ranked | Not available | 12% | 1 benchmark | Reported |
| Inst. FollowingRank Not rankedWeight 5%1 benchmarkReported | 67.0 | Not ranked | Not available | 5% | 1 benchmark | Reported |
Chatbot Arena performance
Scroll horizontally to inspect confidence intervals and vote counts.
| View | Elo | Confidence interval | Votes |
|---|---|---|---|
| Text Overall | 1365 | Not available | Not available |
Benchmark Details
Rows below have a displayable published verification record. Each source link and provenance note remains in the page HTML while its category is closed. Source-unverified manual rows and generated rows stay hidden.
Agentic4 benchmarks
Artificial Analysis Agentic Index
τ²-Bench Tool-Agent-User Evaluation
GDPval-AA normalized
Coding2 benchmarks
Artificial Analysis Coding Index
Artificial Analysis SciCode
Reasoning2 benchmarks
Artificial Analysis Long Context Reasoning
Critical Physics Tasks
Knowledge6 benchmarks
Artificial Analysis GPQA Diamond
Artificial Analysis Humanity's Last Exam
Artificial Analysis Omniscience Index
Artificial Analysis Omniscience Accuracy
Artificial Analysis Omniscience Hallucination Rate
Multimodal1 benchmark
Artificial Analysis MMMU-Pro
Inst. Following1 benchmark
Artificial Analysis IFBench
Frequently Asked Questions
How does Gemma 3 27B perform overall in AI benchmarks?
Gemma 3 27B has 16 published benchmark scores on BenchLM, but it does not yet have enough non-generated coverage to receive a global overall rank.
Is Gemma 3 27B good for knowledge and understanding?
Gemma 3 27B has visible benchmark coverage in knowledge and understanding, but BenchLM does not currently assign it a global category rank there.
Is Gemma 3 27B good for coding and programming?
Gemma 3 27B ranks #108 out of 122 models in coding and programming benchmarks with an average score of 37.8. There are stronger options in this category.
Is Gemma 3 27B good for reasoning and logic?
Gemma 3 27B has visible benchmark coverage in reasoning and logic, but BenchLM does not currently assign it a global category rank there.
Is Gemma 3 27B good for agentic tool use and computer tasks?
Gemma 3 27B ranks #105 out of 119 models in agentic tool use and computer tasks benchmarks with an average score of 35.9. There are stronger options in this category.
Is Gemma 3 27B good for multimodal and grounded tasks?
Gemma 3 27B has visible benchmark coverage in multimodal and grounded tasks, but BenchLM does not currently assign it a global category rank there.
Is Gemma 3 27B good for instruction following?
Gemma 3 27B has visible benchmark coverage in instruction following, but BenchLM does not currently assign it a global category rank there.
Is Gemma 3 27B open source?
Yes, Gemma 3 27B is an open weight model created by Google, meaning it can be downloaded and run locally or fine-tuned for specific use cases.
Does Gemma 3 27B have full benchmark coverage on BenchLM?
Not yet. Gemma 3 27B currently has 16 published benchmark scores out of the 321 benchmarks BenchLM tracks. BenchLM only exposes non-generated public benchmark rows, so missing categories stay blank until a sourced evaluation is available.
What is the context window size of Gemma 3 27B?
Gemma 3 27B has a published context window of 32K, which determines how much text it can process in a single interaction.
Related Resources
Choose with this week’s evidence
Join 2,000+ readers for ranking moves, new releases, pricing changes, and the evidence behind them.
Free. One email per week.