Head-to-head comparison across 1benchmark categories. Overall scores shown here use BenchLM's provisional ranking lane.
Gemma 4 26B A4B
55
ZAYA1-74B-Preview
54
Pick Gemma 4 26B A4B if you want the stronger benchmark profile. ZAYA1-74B-Preview only becomes the better choice if knowledge is the priority.
Knowledge
+15.1 difference
Gemma 4 26B A4B
ZAYA1-74B-Preview
$0 / $0
$0 / $0
N/A
N/A
N/A
N/A
256K
256K
Pick Gemma 4 26B A4B if you want the stronger benchmark profile. ZAYA1-74B-Preview only becomes the better choice if knowledge is the priority.
Gemma 4 26B A4B finishes one point ahead on BenchLM's provisional leaderboard, 55 to 54. That is enough to call, but not enough to treat as a blowout. This matchup comes down to a few meaningful edges rather than one model dominating the board.
Gemma 4 26B A4B is ahead on BenchLM's provisional leaderboard, 55 to 54. The biggest single separator in this matchup is MMLU-Pro, where the scores are 82.6% and 68.1%.
ZAYA1-74B-Preview has the edge for knowledge tasks in this comparison, averaging 64.3 versus 49.2. Inside this category, MMLU-Pro is the benchmark that creates the most daylight between them.
For engineers, researchers, and the plain curious — a weekly brief on new models, ranking shifts, and pricing changes.
Free. No spam. Unsubscribe anytime.