Skip to main content
BenchLM
Advertise

Model comparison

Qwen3.7 Plus vs ZAYA1-8B

Data verified

Head-to-head evidence from 9 shared benchmark results across 4 categories. Overall scores shown here use the public BenchAlign v5 ranking lane.

67.22/100
No comparison
ZAYA1-8B
Zyphra
N/A
2 category wins1 category wins

Public leaderboard positions: Qwen3.7 Plus #21 (Supported); ZAYA1-8B unranked (Not scored). Intervals and evidence labels describe ranking uncertainty, not a guarantee for a specific workload.

Evidence parity. Qwen3.7 Plus and ZAYA1-8B share 9 comparable benchmark results. 3 of 8 categories are comparable. 60 results are unique to Qwen3.7 Plus; 2 to ZAYA1-8B.

Updated July 23, 2026
Shared results
9
Qwen3.7 Plus only
60
ZAYA1-8B only
2
Comparable categories
3 / 8

Treat this as a split decision. Qwen3.7 Plus makes more sense if instruction following is the priority or you need the larger 1M context window; ZAYA1-8B is the better fit if knowledge is the priority.

Confidence note. This is a partial-evidence comparison with 9 shared benchmark results across 4 evidence categories; 3 of 8 categories currently have scoreable aggregates for both models. Treat the verdict as directional until coverage is more balanced.

Why this result

Qwen3.7 Plus and ZAYA1-8B finish on the same BenchAlign overall score, so this is less about a single winner and more about where the edge shows up. The BenchAlign headline says tie; the benchmark table is where the real choice happens.

Qwen3.7 Plus gives you the larger context window at 1M, compared with 131K for ZAYA1-8B.

Category breakdown

Exact category averages are shown below. Not measured means BenchLM does not have enough sourced public coverage for that model and category.

Category scores and score margins for Qwen3.7 Plus and ZAYA1-8B
CategoryQwen3.7 PlusΔZAYA1-8B
Inst. FollowingQwen3.7 Plus84.5Margin← 20.4ZAYA1-8B64.1
KnowledgeQwen3.7 Plus60.1Margin→ 13.5ZAYA1-8B73.6
MathQwen3.7 Plus92.9Margin← 12.5ZAYA1-8B80.4
AgenticQwen3.7 Plus71.7MarginNo overlapZAYA1-8BNot measured
CodingQwen3.7 Plus75.6MarginNo overlapZAYA1-8BNot measured
ReasoningQwen3.7 Plus91.7MarginNo overlapZAYA1-8BNot measured
MultilingualQwen3.7 Plus85.4MarginNo overlapZAYA1-8BNot measured
MultimodalQwen3.7 Plus81.5MarginNo overlapZAYA1-8BNot measured

Decisive benchmark drivers

The largest measured benchmark gaps in this matchup, with exact reported values.

More
A · Qwen3.7 PlusB · ZAYA1-8B

  1. IFBench

    Inst. Following
    Source ↗
    A 79.1%B 52.6%
    Winner: Qwen3.7 PlusΔ 26.5
    IFBench: Qwen3.7 Plus scored 79.1%; ZAYA1-8B scored 52.6%. Qwen3.7 Plus wins this benchmark.

  2. HMMT Feb 2026

    Math
    Source ↗
    A 92.9%B 71.6%
    Winner: Qwen3.7 PlusΔ 21.3
    HMMT Feb 2026: Qwen3.7 Plus scored 92.9%; ZAYA1-8B scored 71.6%. Qwen3.7 Plus wins this benchmark.

  3. GPQA

    Knowledge
    Source ↗
    A 90.3%B 71%
    Winner: Qwen3.7 PlusΔ 19.3
    GPQA: Qwen3.7 Plus scored 90.3%; ZAYA1-8B scored 71%. Qwen3.7 Plus wins this benchmark.

  4. MMLU-Pro

    Knowledge
    Source ↗
    A 88.5%B 74.2%
    Winner: Qwen3.7 PlusΔ 14.3
    MMLU-Pro: Qwen3.7 Plus scored 88.5%; ZAYA1-8B scored 74.2%. Qwen3.7 Plus wins this benchmark.

  5. IFEval

    Inst. Following
    Source ↗
    A 94.6%B 85.6%
    Winner: Qwen3.7 PlusΔ 9
    IFEval: Qwen3.7 Plus scored 94.6%; ZAYA1-8B scored 85.6%. Qwen3.7 Plus wins this benchmark.

Operational comparison

Runtime and commercial metrics are compared only when both models have a complete sourced value.

MetricQwen3.7 PlusZAYA1-8BComparison
Input / output priceUSD per 1M tokensQwen3.7 PlusNot availableZAYA1-8B$0 input / $0 outputA complete price comparison is not available.
Generation speedtokens per secondQwen3.7 PlusNot availableZAYA1-8BNot availableA complete speed comparison is not available.
First-answer latencyseconds to first tokenQwen3.7 PlusNot availableZAYA1-8BNot availableA complete latency comparison is not available.
Context windowmaximum listed tokensQwen3.7 Plus1MZAYA1-8B131KQwen3.7 Plus lists the larger context window.

Benchmark Deep Dive

Agentic
BenchmarkQwen3.7 PlusZAYA1-8BResult
Terminal-Bench 2.0Source 70.3%—Not comparable
QwenClawBenchSource 61.8%—Not comparable
QwenWebBenchSource 1536—Not comparable
Claw-EvalSource 62.7%—Not comparable
BFCL v4Source 72.9%39.2%Qwen3.7 Plus leads
MCP AtlasSource 73.2%—Not comparable
VITA-BenchSource 45.6%—Not comparable
DeepPlanningSource 62.3%—Not comparable
OSWorld-VerifiedSource 73.3%—Not comparable
AndroidWorldSource 81.0%—Not comparable
AA Agentic IndexSource 20.8%—Not comparable
APEX-Agents-AASource 22.4%—Not comparable
τ²-bench resultsSource 93%—Not comparable
GDPval-AASource 21.8%—Not comparable
GDPval-AASource 936—Not comparable
OSWorld 2.0Source 2.8%—Not comparable
Coding
BenchmarkQwen3.7 PlusZAYA1-8BResult
Terminal-Bench 2.0Source 70.3%—Not comparable
SWE-bench VerifiedSource 77.7%—Not comparable
SWE-bench ProSource 57.6%—Not comparable
SWE MultilingualSource 75.8%—Not comparable
NL2RepoSource 41.1%—Not comparable
SciCodeSource 51.3%—Not comparable
LiveCodeBenchSource 89.6%—Not comparable
AA Coding IndexSource 55.9%—Not comparable
AA-SciCodeSource 45.5%—Not comparable
LiveCodeBench v6Source —65.8%Not comparable
Reasoning
BenchmarkQwen3.7 PlusZAYA1-8BResult
CritPtSource 9.1%—Not comparable
MRCRv2Source 91.7%—Not comparable
AA-LCRSource 65.0%—Not comparable
KnowledgeZAYA1-8B wins
BenchmarkQwen3.7 PlusZAYA1-8BResult
GPQASource 90.3%71%Qwen3.7 Plus leads
GPQA-DSource 90.3%71.0%Qwen3.7 Plus leads
HLESource 34.7%—Not comparable
MMLU-ProSource 88.5%74.2%Qwen3.7 Plus leads
MMLU-ReduxSource 94.5%—Not comparable
SuperGPQASource 71.4%—Not comparable
MMMLUSource 89.0%—Not comparable
Artificial Analysis Intelligence IndexSource 39.0%—Not comparable
AA-GPQA DiamondSource 90.0%—Not comparable
AA-HLESource 33.4%—Not comparable
AA-Omniscience IndexSource 2.4%—Not comparable
AA-Omniscience AccuracySource 22.2%—Not comparable
AA-Omniscience Hallucination RateSource 25.5%—Not comparable
MathQwen3.7 Plus wins
BenchmarkQwen3.7 PlusZAYA1-8BResult
HMMT Feb 2026Source 92.9%71.6%Qwen3.7 Plus leads
IMOAnswerBenchSource 86.0%59.3%Qwen3.7 Plus leads
ApexSource 22.7%32.2%ZAYA1-8B leads
AIME26Source —89.1%Not comparable
Multilingual
BenchmarkQwen3.7 PlusZAYA1-8BResult
MMLU-ProXSource 85.4%—Not comparable
NOVA-63Source 58.8%—Not comparable
INCLUDESource 83.0%—Not comparable
MAXIFESource 88.8%—Not comparable
PolyMathSource 84.0%—Not comparable
Multimodal
BenchmarkQwen3.7 PlusZAYA1-8BResult
MMMU-ProSource 79%—Not comparable
MathVisionSource 90.3%—Not comparable
CharXivSource 85.9%—Not comparable
ERQASource 69.8%—Not comparable
MedXpertQA (MM)Source 71.0%—Not comparable
ScreenSpot ProSource 79.0%—Not comparable
SimpleVQASource 81.7%—Not comparable
MMSearch-PlusSource 41.4%—Not comparable
RealWorldQASource 86.9%—Not comparable
OmniDocBench 1.5Source 91.4%—Not comparable
OCRBench V2Source 70.7%—Not comparable
ODINW13Source 51.1%—Not comparable
Video-MME (with subtitle)Source 88.0%—Not comparable
VideoMMMUSource 85.4%—Not comparable
MLVU (M-Avg)Source 87.4%—Not comparable
AA-MMMU-ProSource 80.5%—Not comparable
Design Arena WebsiteSource 1288—Not comparable
Inst. FollowingQwen3.7 Plus wins
BenchmarkQwen3.7 PlusZAYA1-8BResult
IFEvalSource 94.6%85.6%Qwen3.7 Plus leads
IFBenchSource 79.1%52.6%Qwen3.7 Plus leads
AA-IFBenchSource 78.0%—Not comparable
Frequently Asked Questions (4)

Which is better, Qwen3.7 Plus or ZAYA1-8B?

Qwen3.7 Plus and ZAYA1-8B are tied on the BenchAlign overall score, so the right pick depends on which category matters most for your use case.

Which is better for knowledge tasks, Qwen3.7 Plus or ZAYA1-8B?

ZAYA1-8B has the edge for knowledge tasks in this comparison, averaging 73.6 versus 60.1. Inside this category, GPQA is the benchmark that creates the most daylight between them.

Which is better for math, Qwen3.7 Plus or ZAYA1-8B?

Qwen3.7 Plus has the edge for math in this comparison, averaging 92.9 versus 80.4. Inside this category, IMOAnswerBench is the benchmark that creates the most daylight between them.

Which is better for instruction following, Qwen3.7 Plus or ZAYA1-8B?

Qwen3.7 Plus has the edge for instruction following in this comparison, averaging 84.5 versus 64.1. Inside this category, IFBench is the benchmark that creates the most daylight between them.

Related Comparisons

Explore More

Alibaba Compare Pricing Methodology Find Your Best LLM Overall Rankings
Last updated: July 23, 2026

Choose a model with this week’s evidence

Join 2,000+ readers for ranking moves, pricing changes, and the claims that still need proof.

One email each week. Unsubscribe anytime.