Skip to main content
BenchLM
Advertise

Model comparison

LFM2.5-VL-450M vs Soofi S 30B-A3B

Data verified

Head-to-head evidence from 2 shared benchmark results across 1 category. Overall scores shown here use BenchLM's provisional ranking lane.

34/100
Margin
11.0pts
winning →
Soofi S 30B-A3B
Soofi Project
45/100
0 category wins1 category wins

Evidence parity. LFM2.5-VL-450M and Soofi S 30B-A3B share 2 comparable benchmark results. 1 of 8 categories are comparable. 5 results are unique to LFM2.5-VL-450M; 6 to Soofi S 30B-A3B.

Updated July 15, 2026
Shared results
2
LFM2.5-VL-450M only
5
Soofi S 30B-A3B only
6
Comparable categories
1 / 8

Pick Soofi S 30B-A3B if you want the stronger benchmark profile. LFM2.5-VL-450M only becomes the better choice if its workflow or ecosystem matters more than the raw scoreboard.

Confidence note. This is a partial-evidence comparison with 2 shared benchmark results across 1 evidence category; 1 of 8 categories currently have scoreable aggregates for both models. Treat the verdict as directional until coverage is more balanced.

Why this result

Soofi S 30B-A3B is clearly ahead on the provisional aggregate, 45 to 34. The gap is large enough that you do not need to squint at the spreadsheet to see the difference.

Soofi S 30B-A3B's sharpest advantage is in knowledge, where it averages 49.9 against 20.5. The single biggest benchmark swing on the page is MMLU-Pro, 19.3% to 51.4%.

Soofi S 30B-A3B gives you the larger context window at 1M, compared with 128K for LFM2.5-VL-450M.

Category breakdown

Exact category averages are shown below. Not measured means BenchLM does not have enough sourced public coverage for that model and category.

Category scores and score margins for LFM2.5-VL-450M and Soofi S 30B-A3B
CategoryLFM2.5-VL-450MΔSoofi S 30B-A3B
KnowledgeLFM2.5-VL-450M20.5Margin→ 29.4Soofi S 30B-A3B49.9
Inst. FollowingLFM2.5-VL-450M61.2MarginNo overlapSoofi S 30B-A3BNot measured

Decisive benchmark drivers

The largest measured benchmark gaps in this matchup, with exact reported values.

More
A · LFM2.5-VL-450MB · Soofi S 30B-A3B

  1. MMLU-Pro

    Knowledge
    Source ↗
    A 19.3%B 51.4%
    Winner: Soofi S 30B-A3BΔ 32.1
    MMLU-Pro: LFM2.5-VL-450M scored 19.3%; Soofi S 30B-A3B scored 51.4%. Soofi S 30B-A3B wins this benchmark.

  2. GPQA

    Knowledge
    Source ↗
    A 25.7%B 43.4%
    Winner: Soofi S 30B-A3BΔ 17.7
    GPQA: LFM2.5-VL-450M scored 25.7%; Soofi S 30B-A3B scored 43.4%. Soofi S 30B-A3B wins this benchmark.

Operational comparison

Runtime and commercial metrics are compared only when both models have a complete sourced value.

MetricLFM2.5-VL-450MSoofi S 30B-A3BComparison
Input / output priceUSD per 1M tokensLFM2.5-VL-450M$0 input / $0 outputSoofi S 30B-A3B$0 input / $0 outputListed prices are equal.
Generation speedtokens per secondLFM2.5-VL-450MNot availableSoofi S 30B-A3BNot availableA complete speed comparison is not available.
First-answer latencyseconds to first tokenLFM2.5-VL-450MNot availableSoofi S 30B-A3BNot availableA complete latency comparison is not available.
Context windowmaximum listed tokensLFM2.5-VL-450M128KSoofi S 30B-A3B1MSoofi S 30B-A3B lists the larger context window.

Benchmark Deep Dive

Agentic
BenchmarkLFM2.5-VL-450MSoofi S 30B-A3BResult
BFCL v4Source 21.1%—Not comparable
Coding
BenchmarkLFM2.5-VL-450MSoofi S 30B-A3BResult
HumanEvalSource —73.8%Not comparable
Reasoning
BenchmarkLFM2.5-VL-450MSoofi S 30B-A3BResult
BBHSource —78.8%Not comparable
DROPSource —66.5%Not comparable
KnowledgeSoofi S 30B-A3B wins
BenchmarkLFM2.5-VL-450MSoofi S 30B-A3BResult
GPQASource 25.7%43.4%Soofi S 30B-A3B leads
MMLU-ProSource 19.3%51.4%Soofi S 30B-A3B leads
GPQA-DSource —43.4%Not comparable
AGIEvalSource —66.9%Not comparable
Math
BenchmarkLFM2.5-VL-450MSoofi S 30B-A3BResult
GSM8KSource —86.1%Not comparable
Multimodal
BenchmarkLFM2.5-VL-450MSoofi S 30B-A3BResult
MMMUSource 32.7%—Not comparable
RealWorldQASource 58.4%—Not comparable
CountBenchSource 73.3%—Not comparable
Inst. Following
BenchmarkLFM2.5-VL-450MSoofi S 30B-A3BResult
IFEvalSource 61.2%—Not comparable
Frequently Asked Questions (2)

Which is better, LFM2.5-VL-450M or Soofi S 30B-A3B?

Soofi S 30B-A3B is ahead on BenchLM's provisional leaderboard, 45 to 34. The biggest single separator in this matchup is MMLU-Pro, where the scores are 19.3% and 51.4%.

Which is better for knowledge tasks, LFM2.5-VL-450M or Soofi S 30B-A3B?

Soofi S 30B-A3B has the edge for knowledge tasks in this comparison, averaging 49.9 versus 20.5. Inside this category, MMLU-Pro is the benchmark that creates the most daylight between them.

Related Comparisons

Explore More

LiquidAI Compare Pricing Methodology Find Your Best LLM Overall Rankings
Last updated: July 15, 2026

The AI models change fast. We track them for you.

A weekly brief for engineers and researchers covering new models, ranking shifts, and pricing changes.

Free. No spam. Unsubscribe anytime.