Skip to main content
BenchLM
Data

Data as of October 14, 2026 · How the score is built

EstablishedOpen WeightNon-Reasoning

Released Jun 27, 20248K contextGemma 2 27B IT model card

Gemma 2 27B

Decision readingGemma 2 27B is tracked, but not publicly ranked yet. The profile exposes 1 sourced benchmark rows and leaves unsupported fields blank until a published record exists.

Released Jun 27, 2024 — see all recent releases

Decision snapshot

Each value carries a field reference instead of floating alone. Markers compare this model with the current ranked and priced catalog; they are not absolute quality thresholds.

Capability

Unranked

field median 49.8Not eligible for a public rank

Price

Not listed

input median $0.80No comparable first-party hosted token rate

Speed

Not measured

field median 90 tok/sTime to first token not measured

Context

8Ktokens

field median 256,000Reported for this model; direct source link not stored

Strongest published evidence

Published rows are visible, but no category has enough eligible evidence for a comparative rank.

Validate before choosing

1 published rows leave some tracked benchmark slots empty. No comparable first-party API token rate is published.

Source-linked · 1 displayable benchmark row

Follow model changes

Category score record

Scores and ranks appear only where published evidence can be displayed. The table keeps the score, weight, cohort, and evidence state together.

Category scores, ranks, weighting, benchmark coverage, and evidence status
CategoryScore
AgenticWeight 22%0 benchmarksNot measured
Not measured
CodingWeight 20%0 benchmarksNot measured
Not measured
ReasoningWeight 17%0 benchmarksNot measured
Not measured
MultimodalWeight 12%0 benchmarksNot measured
Not measured
KnowledgeWeight 12%1 benchmarkVerified
Score pending
MultilingualWeight 7%0 benchmarksNot measured
Not measured
Inst. FollowingWeight 5%0 benchmarksNot measured
Not measured
MathWeight 5%0 benchmarksNot measured
Not measured

1 of 670 tracked benchmark slots have displayable evidence · bars run 0–100

Coverage details

How much of this is verified

Coverage is split by category so a strong number never hides a thin evidence base. Verified means the row is tied to a published source; provisional rows remain visible but separate.

  1. AgenticNot measured
  2. CodingNot measured
  3. ReasoningNot measured
  4. MultimodalNot measured
  5. Knowledge1/1 verified
  6. MultilingualNot measured
  7. Inst. FollowingNot measured
  8. MathNot measured
Verified sourceProvisionalNot measured

Benchmark ledger

Knowledge opens by default. The marker compares each value with the best source-verified result in the catalog; provisional leaders do not set the reference. Expand the remaining categories for every published row.

Knowledge1 row
Knowledge benchmark values, best verified comparison, weight, and source status
MMLUMassive Multitask Language UnderstandingScore76.2%Versus best verified row

Best verified: o1 · 91.8%

Gap15.6 behindWeightDisplay only

Bars run 0–100; the dark tick marks the best source-verified value

All 1 rows

Lineage

The sequence follows explicit supersedes links. Each score is estimated for that model; a relative can inform a sparse estimate but never sets a floor, so a newer release can score below an earlier one. Scores and prices remain blank when the corresponding public row or first-party rate is unavailable.

  1. Jun 27, 2024 · you are here

    Gemma 2 27B

    Not publicly ranked · Price not listed

Base entry

Radar

Gemma 2 27B release history

Full release history

Radar confirmed these at the source. Use Gemma 2 27B in your work? Explore Radar to follow supported changes and choose your alerts.

Radar

Spec sheet

Each documented value carries its source. Missing fields stay visible as not sourced or not published, rather than disappearing from the page.

API model ID
Not published
Context window
8K
Maximum output
Not sourced yet
Knowledge cutoff
Not sourced yet
Input modalities
Not sourced yet
Output modalities
Not sourced yet
Parameters
Not sourced yet
Availability
Not sourced yet
Cloud regions
Not tracked yet
Lifecycle
Established
API capabilities
Tool calling, structured outputs, and batch support are not tracked yet
Prompt caching
Not documented in the pricing record
Self-host
Open weights available; hardware estimate not sourced
Rate limits
Not tracked yet

How to read this profile

The visual layer above carries the decisions. These notes preserve the model, ranking, coverage, and family context behind the numbers.

We track Gemma 2 27B, but the public leaderboard excludes this profile until enough non-generated benchmark coverage is available. Only published rows appear above.

Gemma 2 27B is a open weight model with a 8K context window. No explicit reasoning mode is documented in this profile.

Official exact values from the Gemma 2 technical report; Google publishes most Gemma 2 scores for the pretrained model only, so BenchLM stores just the instruction-tuned MMLU result. BenchLM stores mmlu. Each value's source and evaluation setting is recorded in row-level source verification. Kept out of rankings because the published results cover few of the benchmarks BenchLM ranks on.

1 of 670 tracked benchmark slots currently have displayable evidence. Missing categories stay blank.

Last updated October 14, 2026. Runtime fields remain blank until a sourced snapshot exists.

Deployment options

Self-host and provider-specific paths stay separate from benchmark evidence so operating constraints are visible before a score becomes the whole decision.

Published weights are available, but BenchLM does not yet have a sourced parameter and VRAM profile for this exact model. Hardware cost estimates stay unavailable until that sizing record is complete.

Estimate VRAM from known parameters

Questions

How does Gemma 2 27B perform overall in AI benchmarks?

Gemma 2 27B has 1 source-displayable benchmark rows, but it does not qualify for a public overall rank. The available rows remain visible by category without being converted into a site-wide score. Missing evidence stays blank instead of being estimated from an earlier model.

Is Gemma 2 27B good for knowledge and understanding?

Gemma 2 27B has source-displayable benchmark coverage for knowledge and understanding, but the public category table does not assign it a rank there. The individual rows remain available for inspection. A missing category position means the evidence threshold was not met; it does not convert the model's unmeasured work into a zero.

Is Gemma 2 27B open source?

Gemma 2 27B is an open-weight model from Google. Its weights can be downloaded for local or hosted deployment, subject to the published license. Open weight does not automatically mean open source: training data and training code may remain private, and commercial restrictions can still apply.

Does Gemma 2 27B have full benchmark coverage on BenchLM?

No. Gemma 2 27B currently has 1 source-displayable rows across 670 tracked benchmark slots. The profile exposes published, non-generated evidence and leaves missing categories blank until an exact evaluation is available. Coverage describes how much was measured; it is not a penalty added to an individual benchmark result.

What is the context window size of Gemma 2 27B?

Gemma 2 27B has a reported context window of 8K in the exact-model catalog record. The value stays visible, but the profile marks its source link as unavailable instead of presenting it as directly documented. Maximum output length remains separate because providers often publish a different limit.

Watch Gemma 2 27B in the weekly brief

Get one weekly email when material rank, price, availability, or benchmark evidence changes are worth revisiting.

Read a sample issue

Join 5,500+ readers.

Compare Gemma 2 27B with every tracked model931 comparisons