Skip to main content

Model comparison

LFM2.5-8B-A1B vs Qwen3.5-35B-A3B

Data verified

Head-to-head evidence from 13 shared benchmark results across 5 categories. Overall scores shown here use the public BenchAlign v5 ranking lane.

41.25/100
Margin
15.6pts
winning →
56.87/100
0 category wins1 category wins

Verified leaderboard positions: LFM2.5-8B-A1B unranked; Qwen3.5-35B-A3B #30

BenchAlign evidence: LFM2.5-8B-A1B estimated; Qwen3.5-35B-A3B supported. Intervals and evidence labels describe ranking uncertainty, not a guarantee for a specific workload.

Evidence parity. LFM2.5-8B-A1B and Qwen3.5-35B-A3B share 13 comparable benchmark results. 1 of 8 categories are comparable. 5 results are unique to LFM2.5-8B-A1B; 16 to Qwen3.5-35B-A3B.

Updated July 16, 2026
Shared results
13
LFM2.5-8B-A1B only
5
Qwen3.5-35B-A3B only
16
Comparable categories
1 / 8

Pick Qwen3.5-35B-A3B if you want the stronger benchmark profile. LFM2.5-8B-A1B only becomes the better choice if its workflow or ecosystem matters more than the raw scoreboard.

Confidence note. This is a partial-evidence comparison with 13 shared benchmark results across 5 evidence categories; 1 of 8 categories currently have scoreable aggregates for both models. Treat the verdict as directional until coverage is more balanced.

Why this result

Qwen3.5-35B-A3B is clearly ahead on the provisional aggregate, 54 to 37. The gap is large enough that you do not need to squint at the spreadsheet to see the difference.

Qwen3.5-35B-A3B's sharpest advantage is in instruction following, where it averages 91.9 against 68.8. The single biggest benchmark swing on the page is IFEval, 91.8% to 91.9%.

Qwen3.5-35B-A3B gives you the larger context window at 262K, compared with 128K for LFM2.5-8B-A1B.

Category breakdown

Exact category averages are shown below. Not measured means BenchLM does not have enough sourced public coverage for that model and category.

Category scores and score margins for LFM2.5-8B-A1B and Qwen3.5-35B-A3B
CategoryLFM2.5-8B-A1BΔQwen3.5-35B-A3B
Inst. FollowingLFM2.5-8B-A1B68.8Margin 23.1Qwen3.5-35B-A3B91.9
AgenticLFM2.5-8B-A1BNot measuredMarginNo overlapQwen3.5-35B-A3B51.0
CodingLFM2.5-8B-A1BNot measuredMarginNo overlapQwen3.5-35B-A3B60.6
ReasoningLFM2.5-8B-A1BNot measuredMarginNo overlapQwen3.5-35B-A3B59.0
KnowledgeLFM2.5-8B-A1BNot measuredMarginNo overlapQwen3.5-35B-A3B81.7
MathLFM2.5-8B-A1B50.0MarginNo overlapQwen3.5-35B-A3BNot measured
MultilingualLFM2.5-8B-A1BNot measuredMarginNo overlapQwen3.5-35B-A3B81.0

Decisive benchmark drivers

The largest measured benchmark gaps in this matchup, with exact reported values.

More
A · LFM2.5-8B-A1BB · Qwen3.5-35B-A3B
  1. IFEval

    Inst. Following
    Source ↗
    A 91.8%B 91.9%
    Winner: Qwen3.5-35B-A3BΔ 0.1
    IFEval: LFM2.5-8B-A1B scored 91.8%; Qwen3.5-35B-A3B scored 91.9%. Qwen3.5-35B-A3B wins this benchmark.

Operational comparison

Runtime and commercial metrics are compared only when both models have a complete sourced value.

MetricLFM2.5-8B-A1BQwen3.5-35B-A3BComparison
Input / output priceUSD per 1M tokensLFM2.5-8B-A1B$0 input / $0 outputQwen3.5-35B-A3B$0 input / $0 outputListed prices are equal.
Generation speedtokens per secondLFM2.5-8B-A1BNot availableQwen3.5-35B-A3BNot availableA complete speed comparison is not available.
First-answer latencyseconds to first tokenLFM2.5-8B-A1BNot availableQwen3.5-35B-A3BNot availableA complete latency comparison is not available.
Context windowmaximum listed tokensLFM2.5-8B-A1B128KQwen3.5-35B-A3B262KQwen3.5-35B-A3B lists the larger context window.

Benchmark Deep Dive

Agentic
BenchmarkLFM2.5-8B-A1BQwen3.5-35B-A3BResult
BFCL v4Source 49.7%Not comparable
τ²-bench resultsSource 16.1%89.2%Qwen3.5-35B-A3B leads
Terminal-Bench 2.0Source 40.5%Not comparable
BrowseCompSource 61%Not comparable
OSWorld-VerifiedSource 54.5%Not comparable
Gert LabsSource 28.96%Not comparable
Coding
BenchmarkLFM2.5-8B-A1BQwen3.5-35B-A3BResult
Terminal-Bench HardSource 4.5%26.5%Qwen3.5-35B-A3B leads
AA-SciCodeSource 7.8%37.7%Qwen3.5-35B-A3B leads
SWE-bench VerifiedSource 69.2%Not comparable
SWE-RebenchSource 53.7%Not comparable
Reasoning
BenchmarkLFM2.5-8B-A1BQwen3.5-35B-A3BResult
AA-LCRSource 0.0%62.7%Qwen3.5-35B-A3B leads
CritPtSource 0.0%0.9%Qwen3.5-35B-A3B leads
LongBench v2Source 59%Not comparable
Knowledge
BenchmarkLFM2.5-8B-A1BQwen3.5-35B-A3BResult
AA-GPQA DiamondSource 51.3%84.5%Qwen3.5-35B-A3B leads
AA-HLESource 6.9%19.7%Qwen3.5-35B-A3B leads
AA-Omniscience IndexSource -33.3%-46.4%LFM2.5-8B-A1B leads
AA-Omniscience AccuracySource 9.4%20.5%Qwen3.5-35B-A3B leads
AA-Omniscience Hallucination RateSource 47.0%84.0%LFM2.5-8B-A1B leads
Artificial Analysis Intelligence IndexSource 8.3%29.3%Qwen3.5-35B-A3B leads
MMLU-ProSource 85.3%Not comparable
SuperGPQASource 63.4%Not comparable
GPQASource 84.2%Not comparable
Math
BenchmarkLFM2.5-8B-A1BQwen3.5-35B-A3BResult
MATH-500Source 88.8%Not comparable
AIME 2025Source 42.5%Not comparable
AIME26Source 50.0%Not comparable
Multilingual
BenchmarkLFM2.5-8B-A1BQwen3.5-35B-A3BResult
MMLU-ProXSource 81%Not comparable
Multimodal
BenchmarkLFM2.5-8B-A1BQwen3.5-35B-A3BResult
MMMUSource 81.4%Not comparable
MMVUSource 72.3%Not comparable
MathVisionSource 83.9%Not comparable
V*Source 92.7%Not comparable
AA-MMMU-ProSource 72.7%Not comparable
Inst. FollowingQwen3.5-35B-A3B wins
BenchmarkLFM2.5-8B-A1BQwen3.5-35B-A3BResult
IFEvalSource 91.8%91.9%Qwen3.5-35B-A3B leads
IFBenchSource 56.5%Not comparable
AA-IFBenchSource 55.6%72.5%Qwen3.5-35B-A3B leads
Frequently Asked Questions (2)

Which is better, LFM2.5-8B-A1B or Qwen3.5-35B-A3B?

Qwen3.5-35B-A3B is ahead on BenchLM's provisional leaderboard, 54 to 37. The biggest single separator in this matchup is IFEval, where the scores are 91.8% and 91.9%.

Which is better for instruction following, LFM2.5-8B-A1B or Qwen3.5-35B-A3B?

Qwen3.5-35B-A3B has the edge for instruction following in this comparison, averaging 91.9 versus 68.8. Inside this category, AA-IFBench is the benchmark that creates the most daylight between them.

Related Comparisons

Last updated: July 16, 2026

The AI models change fast. We track them for you.

A weekly brief for engineers and researchers covering new models, ranking shifts, and pricing changes.

Free. No spam. Unsubscribe anytime.