Skip to main content

Gemma 4 12B

GoogleCurrentReleased Jun 3, 2026
Overall Score
Unranked
Arena Elo
N/A
Categories Ranked
0of 8
Price (1M tokens)
N/A
Speed
N/A
Context
256K
Open WeightSelf-hostReasoning
Confidence
12b

BenchLM is tracking Gemma 4 12B, but this profile is currently excluded from the public leaderboard because it still lacks enough non-generated benchmark coverage to rank safely. Only non-generated public benchmark rows appear below.

Gemma 4 12B is a open weight model with a 256K token context window. It uses explicit chain-of-thought reasoning, which typically improves performance on math and complex reasoning tasks at the cost of higher latency and token usage.

Gemma 4 12B sits inside the Gemma 4 family alongside Gemma 4 31B, Gemma 4 26B A4B, Gemma 4 E4B, Gemma 4 E2B. This profile currently has 12 of 236 tracked benchmarks. BenchLM only exposes non-generated benchmark rows publicly, so missing categories stay blank until a sourced evaluation is available.

Ranking Distribution

Category rank across 4 benchmark categories — sorted by best rank

Category Performance

Scores across all benchmark categories (0-100 scale)

Category Breakdown

Agentic

0.0/ 100
Weight: 22%0 benchmarks
Terminal-Bench 2.0BrowseCompOSWorld-VerifiedGAIATAU-benchWebArena

Coding

76.7/ 100
Weight: 20%1 benchmark
SWE-bench VerifiedLiveCodeBenchSWE-bench ProSWE-RebenchSciCode

Reasoning

10.1/ 100
Weight: 17%2 benchmarks
MuSRLongBench v2MRCRv2ARC-AGI-2

Knowledge

71.7/ 100
Weight: 12%5 benchmarks
GPQASuperGPQAMMLU-ProHLEFrontierScienceSimpleQA

Math

0.0/ 100
Weight: 5%1 benchmark
AIME 2025BRUMO 2025MATH-500FrontierMath

Multilingual

0.0/ 100
Weight: 7%0 benchmarks
MGSMMMLU-ProX

Multimodal

57.1/ 100
Weight: 12%3 benchmarks
MMMU-ProOfficeQA ProCharXivCharXiv w/o tools

Inst. Following

0.0/ 100
Weight: 5%0 benchmarks
IFEvalIFBench

Benchmark Details

Only benchmark rows with an attached exact-source record are shown here. Source-unverified manual rows and generated rows are hidden from model pages.

Frequently Asked Questions

How does Gemma 4 12B perform overall in AI benchmarks?

Gemma 4 12B has 12 published benchmark scores on BenchLM, but it does not yet have enough non-generated coverage to receive a global overall rank.

Is Gemma 4 12B good for knowledge and understanding?

Gemma 4 12B has visible benchmark coverage in knowledge and understanding, but BenchLM does not currently assign it a global category rank there.

Is Gemma 4 12B good for coding and programming?

Gemma 4 12B has visible benchmark coverage in coding and programming, but BenchLM does not currently assign it a global category rank there.

Is Gemma 4 12B good for mathematics?

Gemma 4 12B has visible benchmark coverage in mathematics, but BenchLM does not currently assign it a global category rank there.

Is Gemma 4 12B good for reasoning and logic?

Gemma 4 12B has visible benchmark coverage in reasoning and logic, but BenchLM does not currently assign it a global category rank there.

Is Gemma 4 12B good for multimodal and grounded tasks?

Gemma 4 12B has visible benchmark coverage in multimodal and grounded tasks, but BenchLM does not currently assign it a global category rank there.

Is Gemma 4 12B open source?

Yes, Gemma 4 12B is an open weight model created by Google, meaning it can be downloaded and run locally or fine-tuned for specific use cases.

Which sibling models are related to Gemma 4 12B?

Gemma 4 12B belongs to the Gemma 4 family. Related variants on BenchLM include Gemma 4 31B, Gemma 4 26B A4B, Gemma 4 E4B, Gemma 4 E2B.

Does Gemma 4 12B have full benchmark coverage on BenchLM?

Not yet. Gemma 4 12B currently has 12 published benchmark scores out of the 236 benchmarks BenchLM tracks. BenchLM only exposes non-generated public benchmark rows, so missing categories stay blank until a sourced evaluation is available.

What is the context window size of Gemma 4 12B?

Gemma 4 12B has a context window of 256K, which determines how much text it can process in a single interaction.

Last updated: June 8, 2026 · Runtime metrics stay blank until BenchLM has a sourced snapshot.

Don't miss the next GPT moment

Which models moved up, what’s new, and what it costs. One email a week, 3-min read.

Free. One email per week.