Skip to main content

Model comparison

LFM2.5-8B-A1B vs Qwen3 235B 2507 (Reasoning)

Data verified

Head-to-head evidence from 0 shared benchmark results across 0 categories. Overall scores shown here use the public BenchAlign v5 ranking lane.

No sourced benchmark result is currently shared by both models. This page therefore compares only the available metadata, pricing, and runtime rows; it does not name a quality winner.
41.42/100
Margin
16.6pts
winning →
1 category wins0 category wins

Public leaderboard positions: LFM2.5-8B-A1B #166 (Estimated); Qwen3 235B 2507 (Reasoning) #66 (Estimated). Intervals and evidence labels describe ranking uncertainty, not a guarantee for a specific workload.

Evidence parity. LFM2.5-8B-A1B and Qwen3 235B 2507 (Reasoning) share 0 comparable benchmark results. 1 of 8 categories are comparable. 17 results are unique to LFM2.5-8B-A1B; 2 to Qwen3 235B 2507 (Reasoning).

Updated July 21, 2026
Shared results
0
LFM2.5-8B-A1B only
17
Qwen3 235B 2507 (Reasoning) only
2
Comparable categories
1 / 8

Pick Qwen3 235B 2507 (Reasoning) if you want the stronger benchmark profile. LFM2.5-8B-A1B only becomes the better choice if mathematics is the priority.

Confidence note. This is a partial-evidence comparison with 0 shared benchmark results across 0 evidence categories; 1 of 8 categories currently have scoreable aggregates for both models. Treat the verdict as directional until coverage is more balanced.

Why this result

Qwen3 235B 2507 (Reasoning) is clearly ahead on the BenchAlign aggregate, 58.01 to 41.42. The gap is large enough that you do not need to squint at the spreadsheet to see the difference.

Operational comparison

Runtime and commercial metrics are compared only when both models have a complete sourced value.

MetricLFM2.5-8B-A1BQwen3 235B 2507 (Reasoning)Comparison
Input / output priceUSD per 1M tokensLFM2.5-8B-A1B$0 input / $0 outputQwen3 235B 2507 (Reasoning)$0 input / $0 outputListed prices are equal.
Generation speedtokens per secondLFM2.5-8B-A1BNot availableQwen3 235B 2507 (Reasoning)Not availableA complete speed comparison is not available.
First-answer latencyseconds to first tokenLFM2.5-8B-A1BNot availableQwen3 235B 2507 (Reasoning)Not availableA complete latency comparison is not available.
Context windowmaximum listed tokensLFM2.5-8B-A1B128KQwen3 235B 2507 (Reasoning)128KListed context windows are equal.

Benchmark Deep Dive

Agentic
BenchmarkLFM2.5-8B-A1BQwen3 235B 2507 (Reasoning)Result
BFCL v4Source 49.7%Not comparable
τ²-bench resultsSource 16.1%Not comparable
Coding
BenchmarkLFM2.5-8B-A1BQwen3 235B 2507 (Reasoning)Result
AA-SciCodeSource 7.8%Not comparable
Reasoning
BenchmarkLFM2.5-8B-A1BQwen3 235B 2507 (Reasoning)Result
AA-LCRSource 0.0%Not comparable
CritPtSource 0.0%Not comparable
Knowledge
BenchmarkLFM2.5-8B-A1BQwen3 235B 2507 (Reasoning)Result
AA-GPQA DiamondSource 51.3%Not comparable
AA-HLESource 6.9%Not comparable
AA-Omniscience IndexSource -33.3%Not comparable
AA-Omniscience AccuracySource 9.4%Not comparable
AA-Omniscience Hallucination RateSource 47.0%Not comparable
Artificial Analysis Intelligence IndexSource 8.3%Not comparable
MathLFM2.5-8B-A1B wins
BenchmarkLFM2.5-8B-A1BQwen3 235B 2507 (Reasoning)Result
MATH-500Source 88.8%Not comparable
AIME 2025Source 42.5%Not comparable
AIME26Source 50.0%Not comparable
FrontierMath v2 (Tiers 1-3)Source 8.481%Not comparable
FrontierMath v2 (Tier 4)Source 0.000%Not comparable
Inst. Following
BenchmarkLFM2.5-8B-A1BQwen3 235B 2507 (Reasoning)Result
IFEvalSource 91.8%Not comparable
IFBenchSource 56.5%Not comparable
AA-IFBenchSource 55.6%Not comparable
Frequently Asked Questions (2)

Which is better, LFM2.5-8B-A1B or Qwen3 235B 2507 (Reasoning)?

Qwen3 235B 2507 (Reasoning) is ahead on BenchLM's BenchAlign leaderboard, 58.01 to 41.42.

Which is better for math, LFM2.5-8B-A1B or Qwen3 235B 2507 (Reasoning)?

LFM2.5-8B-A1B has the edge for math in this comparison, averaging 50 versus 6.4. Qwen3 235B 2507 (Reasoning) stays close enough that the answer can still flip depending on your workload.

Related Comparisons

Last updated: July 21, 2026

Choose a model with this week’s evidence

Join 2,000+ readers for ranking moves, pricing changes, and the claims that still need proof.

One email each week. Unsubscribe anytime.