Skip to main content
BenchLM
Advertise

Model comparison

Soofi S 30B-A3B vs Step 3.7 Flash

Data verified

Head-to-head evidence from 0 shared benchmark results across 0 categories. Overall scores shown here use BenchLM's provisional ranking lane.

Benchmark data for one or both models is coming soon. This page currently shows metadata and pricing where BenchLM has it, and score-level comparisons will populate as public benchmark results land.
Soofi S 30B-A3B
Soofi Project
45/100
Margin
13.0pts
winning →
58/100
0 category wins0 category wins

Evidence parity. Soofi S 30B-A3B and Step 3.7 Flash share 0 comparable benchmark results. 0 of 8 categories are comparable. 8 results are unique to Soofi S 30B-A3B; 30 to Step 3.7 Flash.

Updated July 15, 2026
Shared results
0
Soofi S 30B-A3B only
8
Step 3.7 Flash only
30
Comparable categories
0 / 8

Benchmark data for Soofi S 30B-A3B and Step 3.7 Flash is coming soon on BenchLM.

Confidence note. This is a partial-evidence comparison with 0 shared benchmark results across 0 evidence categories; 0 of 8 categories currently have scoreable aggregates for both models. Treat the verdict as directional until coverage is more balanced.

Why this result

BenchLM has partial data for these models, but not enough overlapping benchmark coverage to produce a fair score-level comparison yet.

Step 3.7 Flash is priced at $0.20 input / $1.15 output per 1M tokens, versus $0.00 input / $0.00 output per 1M tokens for Soofi S 30B-A3B. Soofi S 30B-A3B has the larger context window at 1M, compared with 256K for Step 3.7 Flash.

Operational comparison

Runtime and commercial metrics are compared only when both models have a complete sourced value.

MetricSoofi S 30B-A3BStep 3.7 FlashComparison
Input / output priceUSD per 1M tokensSoofi S 30B-A3B$0 input / $0 outputStep 3.7 Flash$0.2 input / $1.15 outputSoofi S 30B-A3B has the lower combined listed price.
Generation speedtokens per secondSoofi S 30B-A3BNot availableStep 3.7 FlashNot availableA complete speed comparison is not available.
First-answer latencyseconds to first tokenSoofi S 30B-A3BNot availableStep 3.7 FlashNot availableA complete latency comparison is not available.
Context windowmaximum listed tokensSoofi S 30B-A3B1MStep 3.7 Flash256KSoofi S 30B-A3B lists the larger context window.

Benchmark Deep Dive

Agentic
BenchmarkSoofi S 30B-A3BStep 3.7 FlashResult
Terminal-Bench 2.0Source —59.5%Not comparable
BrowseCompSource —75.8%Not comparable
DeepSearchQASource —92.8%Not comparable
GDPval-AASource —25.9%Not comparable
ToolathlonSource —49.5%Not comparable
Claw-EvalSource —67.1%Not comparable
HLE w/ toolsSource —47.2%Not comparable
Gert LabsSource —51.57%Not comparable
AA Agentic IndexSource —21.5%Not comparable
τ²-bench resultsSource —98.5%Not comparable
GDPval-AASource —1017Not comparable
APEX-Agents-AASource —14.8%Not comparable
Coding
BenchmarkSoofi S 30B-A3BStep 3.7 FlashResult
HumanEvalSource 73.8%—Not comparable
SWE-bench ProSource —56.3%Not comparable
Terminal-Bench 2.0Source —59.5%Not comparable
AA Coding IndexSource —39.6%Not comparable
Terminal-Bench HardSource —35.6%Not comparable
AA-SciCodeSource —40.0%Not comparable
Reasoning
BenchmarkSoofi S 30B-A3BStep 3.7 FlashResult
BBHSource 78.8%—Not comparable
DROPSource 66.5%—Not comparable
AA-LCRSource —63.7%Not comparable
CritPtSource —2.3%Not comparable
Knowledge
BenchmarkSoofi S 30B-A3BStep 3.7 FlashResult
GPQASource 43.4%—Not comparable
GPQA-DSource 43.4%—Not comparable
MMLU-ProSource 51.4%—Not comparable
AGIEvalSource 66.9%—Not comparable
Artificial Analysis Intelligence IndexSource —30.3%Not comparable
AA-GPQA DiamondSource —80.9%Not comparable
AA-HLESource —19.9%Not comparable
AA-Omniscience IndexSource —-37.5%Not comparable
AA-Omniscience AccuracySource —25.4%Not comparable
AA-Omniscience Hallucination RateSource —84.4%Not comparable
Math
BenchmarkSoofi S 30B-A3BStep 3.7 FlashResult
GSM8KSource 86.1%—Not comparable
Multimodal
BenchmarkSoofi S 30B-A3BStep 3.7 FlashResult
SimpleVQASource —79.2%Not comparable
V*Source —95.3%Not comparable
AA-MMMU-ProSource —75.3%Not comparable
Design Arena WebsiteSource —1218Not comparable
Inst. Following
BenchmarkSoofi S 30B-A3BStep 3.7 FlashResult
AA-IFBenchSource —67.3%Not comparable
Frequently Asked Questions (3)

Can I compare Soofi S 30B-A3B and Step 3.7 Flash on BenchLM yet?

Not fully yet. BenchLM is tracking both models, but the sourced benchmark breakdown for this comparison is still coming soon.

Why does this comparison show “coming soon”?

BenchLM only shows category winners and benchmark-level calls when we have sourced results that can be compared fairly. For these models, the public benchmark coverage is not complete enough yet.

What data is available for Soofi S 30B-A3B and Step 3.7 Flash today?

Soofi S 30B-A3B: $0.00 input / $0.00 output per 1M tokens Step 3.7 Flash: $0.20 input / $1.15 output per 1M tokens Both model pages still include creator, context window, reasoning mode, and other metadata while benchmark coverage fills in.

Related Comparisons

Explore More

Soofi Project Compare Pricing Methodology Find Your Best LLM Overall Rankings
Last updated: July 15, 2026

The AI models change fast. We track them for you.

A weekly brief for engineers and researchers covering new models, ranking shifts, and pricing changes.

Free. No spam. Unsubscribe anytime.