Math
Directional only- GLM-5.1
- 62.0
- ZAYA1-8B
- 80.4
- Weighted basis
- 4 vs 2 rows
- Reading
- Directional only
Model comparison
Updated August 5, 2026. Public scores include evidence status and uncertainty. They are not guarantees for a specific workload.
GLM-5.1 has the higher public score, 66.9 versus 31.58, and the 90% score intervals do not overlap.
3 results are shared. Category rows based on different benchmark sets are marked directional and do not name a winner.
Recommendations appear only when a shared evidence basis or an explicit operating constraint supports the call. Secondary and unsupported use cases stay disclosed below the initial list.
Prompts that approach the documented context limit
GLM-5.1
GLM-5.1 has the larger documented context window.
Confidence: documented
Code generation, repair, and software-engineering tasks
Not enough matched evidence
No shared weighted benchmark basis supports a winner.
Confidence: limited
Tool use, computer use, and multi-step task completion
Not enough matched evidence
No shared weighted benchmark basis supports a winner.
Confidence: limited
1K fresh input + 500 output tokens
Not enough matched evidence
A complete comparable API-rate estimate is not available for both models.
Confidence: listed-rates
200K cached + 20K fresh input + 10K output tokens
Not enough matched evidence
The page does not recommend a cost winner because at least one model cannot fit the stated workload in one request. GLM-5.1 does not fit this workload in one request. ZAYA1-8B does not fit this workload in one request. GLM-5.1 has no published cached-input rate, so cached tokens use its listed input rate. ZAYA1-8B has no comparable published API token rate.
Confidence: rate-fallback
50K fresh input + 3K output tokens
Not enough matched evidence
A complete comparable API-rate estimate is not available for both models.
Confidence: listed-rates
Shared results can support a head-to-head reading. Results present for only one model describe coverage, not superiority.
1 category uses different evidence sets. Those rows remain visible for coverage context but do not name a winner.
Each row states whether both averages use the same weighted benchmark set. Directional and not-comparable rows remain visible, but they never receive a winner in this template.
| Category | GLM-5.1 | ZAYA1-8B | Weighted basis | Reading |
|---|---|---|---|---|
| Math | 62.0 | 80.4 | Directional only4 vs 2 rows | Directional only |
| Agentic | 65.4 | Not measured | Not comparable2 vs 0 rows | Not comparable |
| Coding | 61.3 | Not measured | Not comparable2 vs 0 rows | Not comparable |
| Reasoning | Not measured | Not measured | Not comparable0 vs 0 rows | Not comparable |
| Knowledge | 52.3 | 73.6 | Not comparable1 vs 2 rows | Not comparable |
| Multilingual | Not measured | Not measured | Not comparable0 vs 0 rows | Not comparable |
| Multimodal | Not measured | Not measured | Not comparable0 vs 0 rows | Not comparable |
| Instruction following | Not measured | 64.1 | Not comparable0 vs 2 rows | Not comparable |
Only shared public evidence is shown. Sparse evidence stays a ruled list rather than being closed into a radar shape.
Too few matched category axes support a radar. The ruled list below shows only shared benchmark results; positions use each benchmark’s normalized display scale when available.
HMMT Feb 2026
Math
AIME26
Math
Three fixed token mixes turn per-token rates into comparable decisions. Each scenario states context fit and whether cached input had to fall back to the published list-input rate.
1K fresh input + 500 output tokens
ZAYA1-8B has no comparable published API token rate.
50K fresh input + 3K output tokens
ZAYA1-8B has no comparable published API token rate.
200K cached + 20K fresh input + 10K output tokens
GLM-5.1 does not fit this workload in one request. ZAYA1-8B does not fit this workload in one request. GLM-5.1 has no published cached-input rate, so cached tokens use its listed input rate. ZAYA1-8B has no comparable published API token rate.
Sourced differences are shown directly. Missing facts stay explicit instead of being inferred from a model name or family.
Maximum documented context; output-token limits may be lower.
GLM-5.1
203K
ZAYA1-8B
131K
GLM-5.1
Not sourced
ZAYA1-8B
Not sourced
A missing cached-input rate falls back to the listed input rate only in the stated workload estimate.
GLM-5.1
Not published
ZAYA1-8B
No comparable hosted API rate
GLM-5.1
Not sourced
ZAYA1-8B
Not sourced
GLM-5.1
Not sourced
ZAYA1-8B
Not sourced
GLM-5.1
Not sourced
ZAYA1-8B
Not sourced
GLM-5.1
Reasoning
ZAYA1-8B
Reasoning
GLM-5.1
Open Weight
ZAYA1-8B
Open Weight
GLM-5.1
Open Weight
ZAYA1-8B
Open Weight
GLM-5.1
2026-04-07
ZAYA1-8B
2026-05-05
Run the same representative tasks against both endpoints before changing production traffic.
Estimates at 50,000 req/day · 1000 tokens/req average.
The full public result ledger is available for audit without forcing a wide desktop table onto a phone.
Terminal-Bench 2.0
Not directly comparable
BrowseComp
Not directly comparable
τ³-bench results
Not directly comparable
MCP Atlas
Not directly comparable
CyberGym
Not directly comparable
Claw-Eval
Not directly comparable
Gert Labs
Not directly comparable
ResearchClawBench
Not directly comparable
BFCL v4
Not directly comparable
SWE-bench Pro
Not directly comparable
NL2Repo
Not directly comparable
SWE-Rebench
Not directly comparable
Vibe Code Bench
Not directly comparable
LiveCodeBench v6
Not directly comparable
AIME26
GLM-5.1 leads this result
HMMT Nov 2025
Not directly comparable
HMMT Feb 2026
GLM-5.1 leads this result
MMAnswerBench
Not directly comparable
FrontierMath v2 (Tiers 1-3)
Not directly comparable
FrontierMath v2 (Tier 4)
Not directly comparable
IMOAnswerBench
Not directly comparable
Apex
Not directly comparable
GLM-5.1 has the higher public score, 66.9 versus 31.58, and the 90% score intervals do not overlap. That is the clearest overall quality signal in the current public data.
The published evidence does not provide a shared weighted coding basis for both models, so BenchLM does not name a coding winner.
The published evidence does not provide a shared weighted agentic tasks basis for both models, so BenchLM does not name a agentic tasks winner.
Both models do not have comparable published API token rates, so this page does not name a universal price winner.
GLM-5.1 has the larger documented context window: 203K, compared with 131K.
Last updated August 5, 2026
One weekly email when material rank, price, or benchmark evidence changes make this matchup worth revisiting.
Read a sample issueJoin 2,000+ readers.