Skip to main content

Model comparison

Qwen3 235B 2507 vs Soofi S 30B-A3B

Data verified

Head-to-head evidence from 2 shared benchmark results across 1 category. Overall scores shown here use BenchLM's provisional ranking lane.

34/100
Margin
11.0pts
winning →
Soofi Project
45/100
1 category wins0 category wins

Evidence parity. Qwen3 235B 2507 and Soofi S 30B-A3B share 2 comparable benchmark results. 1 of 8 categories are comparable. 2 results are unique to Qwen3 235B 2507; 6 to Soofi S 30B-A3B.

Updated July 15, 2026
Shared results
2
Qwen3 235B 2507 only
2
Soofi S 30B-A3B only
6
Comparable categories
1 / 8

Pick Soofi S 30B-A3B if you want the stronger benchmark profile. Qwen3 235B 2507 only becomes the better choice if knowledge is the priority.

Confidence note. This is a partial-evidence comparison with 2 shared benchmark results across 1 evidence category; 1 of 8 categories currently have scoreable aggregates for both models. Treat the verdict as directional until coverage is more balanced.

Why this result

Soofi S 30B-A3B is clearly ahead on the provisional aggregate, 45 to 34. The gap is large enough that you do not need to squint at the spreadsheet to see the difference.

Soofi S 30B-A3B gives you the larger context window at 1M, compared with 128K for Qwen3 235B 2507.

Category breakdown

Exact category averages are shown below. Not measured means BenchLM does not have enough sourced public coverage for that model and category.

Category scores and score margins for Qwen3 235B 2507 and Soofi S 30B-A3B
CategoryQwen3 235B 2507ΔSoofi S 30B-A3B
KnowledgeQwen3 235B 250779.0Margin 29.1Soofi S 30B-A3B49.9
MultilingualQwen3 235B 250779.4MarginNo overlapSoofi S 30B-A3BNot measured

Decisive benchmark drivers

The largest measured benchmark gaps in this matchup, with exact reported values.

More
A · Qwen3 235B 2507B · Soofi S 30B-A3B
  1. GPQA

    Knowledge
    Source ↗
    A 77.5%B 43.4%
    Winner: Qwen3 235B 2507Δ 34.1
    GPQA: Qwen3 235B 2507 scored 77.5%; Soofi S 30B-A3B scored 43.4%. Qwen3 235B 2507 wins this benchmark.
  2. MMLU-Pro

    Knowledge
    Source ↗
    A 83%B 51.4%
    Winner: Qwen3 235B 2507Δ 31.6
    MMLU-Pro: Qwen3 235B 2507 scored 83%; Soofi S 30B-A3B scored 51.4%. Qwen3 235B 2507 wins this benchmark.

Operational comparison

Runtime and commercial metrics are compared only when both models have a complete sourced value.

MetricQwen3 235B 2507Soofi S 30B-A3BComparison
Input / output priceUSD per 1M tokensQwen3 235B 2507$0 input / $0 outputSoofi S 30B-A3B$0 input / $0 outputListed prices are equal.
Generation speedtokens per secondQwen3 235B 2507Not availableSoofi S 30B-A3BNot availableA complete speed comparison is not available.
First-answer latencyseconds to first tokenQwen3 235B 2507Not availableSoofi S 30B-A3BNot availableA complete latency comparison is not available.
Context windowmaximum listed tokensQwen3 235B 2507128KSoofi S 30B-A3B1MSoofi S 30B-A3B lists the larger context window.

Benchmark Deep Dive

Coding
BenchmarkQwen3 235B 2507Soofi S 30B-A3BResult
HumanEvalSource 73.8%Not comparable
Reasoning
BenchmarkQwen3 235B 2507Soofi S 30B-A3BResult
BBHSource 78.8%Not comparable
DROPSource 66.5%Not comparable
KnowledgeQwen3 235B 2507 wins
BenchmarkQwen3 235B 2507Soofi S 30B-A3BResult
GPQASource 77.5%43.4%Qwen3 235B 2507 leads
SuperGPQASource 62.6%Not comparable
MMLU-ProSource 83%51.4%Qwen3 235B 2507 leads
GPQA-DSource 43.4%Not comparable
AGIEvalSource 66.9%Not comparable
Math
BenchmarkQwen3 235B 2507Soofi S 30B-A3BResult
GSM8KSource 86.1%Not comparable
Multilingual
BenchmarkQwen3 235B 2507Soofi S 30B-A3BResult
MMLU-ProXSource 79.4%Not comparable
Frequently Asked Questions (2)

Which is better, Qwen3 235B 2507 or Soofi S 30B-A3B?

Soofi S 30B-A3B is ahead on BenchLM's provisional leaderboard, 45 to 34. The biggest single separator in this matchup is GPQA, where the scores are 77.5% and 43.4%.

Which is better for knowledge tasks, Qwen3 235B 2507 or Soofi S 30B-A3B?

Qwen3 235B 2507 has the edge for knowledge tasks in this comparison, averaging 79 versus 49.9. Inside this category, GPQA is the benchmark that creates the most daylight between them.

Related Comparisons

Last updated: July 15, 2026

The AI models change fast. We track them for you.

A weekly brief for engineers and researchers covering new models, ranking shifts, and pricing changes.

Free. No spam. Unsubscribe anytime.