Head-to-head comparison across 1benchmark categories. Overall scores shown here use BenchLM's provisional ranking lane.
Gemma 4 26B A4B
56
ZAYA1-8B
62
Pick ZAYA1-8B if you want the stronger benchmark profile. Gemma 4 26B A4B only becomes the better choice if you need the larger 256K context window.
Knowledge
+23.9 difference
Gemma 4 26B A4B
ZAYA1-8B
$0 / $0
$0 / $0
N/A
N/A
N/A
N/A
256K
131K
Pick ZAYA1-8B if you want the stronger benchmark profile. Gemma 4 26B A4B only becomes the better choice if you need the larger 256K context window.
ZAYA1-8B is clearly ahead on the provisional aggregate, 62 to 56. The gap is large enough that you do not need to squint at the spreadsheet to see the difference.
ZAYA1-8B's sharpest advantage is in knowledge, where it averages 73.1 against 49.2. The single biggest benchmark swing on the page is MMLU-Pro, 82.6% to 74.2%.
Gemma 4 26B A4B gives you the larger context window at 256K, compared with 131K for ZAYA1-8B.
ZAYA1-8B is ahead on BenchLM's provisional leaderboard, 62 to 56. The biggest single separator in this matchup is MMLU-Pro, where the scores are 82.6% and 74.2%.
ZAYA1-8B has the edge for knowledge tasks in this comparison, averaging 73.1 versus 49.2. Inside this category, MMLU-Pro is the benchmark that creates the most daylight between them.
For engineers, researchers, and the plain curious — a weekly brief on new models, ranking shifts, and pricing changes.
Free. No spam. Unsubscribe anytime.