Skip to main content

Model comparison

DeepSeek V3 vs LFM2.5-VL-1.6B-Extract

Data verified

Head-to-head evidence from 11 shared benchmark results across 5 categories. Overall scores shown here use the public BenchAlign v5 ranking lane.

DeepSeek
44.97/100
No comparison
0 category wins0 category wins

Public leaderboard positions: DeepSeek V3 #147 (Supported); LFM2.5-VL-1.6B-Extract unranked (Not scored). Intervals and evidence labels describe ranking uncertainty, not a guarantee for a specific workload.

Evidence parity. DeepSeek V3 and LFM2.5-VL-1.6B-Extract share 11 comparable benchmark results. 0 of 8 categories are comparable. 11 results are unique to DeepSeek V3; 4 to LFM2.5-VL-1.6B-Extract.

Updated July 23, 2026
Shared results
11
DeepSeek V3 only
11
LFM2.5-VL-1.6B-Extract only
4
Comparable categories
0 / 8

Benchmark data for DeepSeek V3 and LFM2.5-VL-1.6B-Extract is coming soon on BenchLM.

Confidence note. This is a partial-evidence comparison with 11 shared benchmark results across 5 evidence categories; 0 of 8 categories currently have scoreable aggregates for both models. Treat the verdict as directional until coverage is more balanced.

Why this result

BenchLM has partial data for these models, but not enough overlapping benchmark coverage to produce a fair score-level comparison yet.

Category breakdown

Exact category averages are shown below. Not measured means BenchLM does not have enough sourced public coverage for that model and category.

Category scores and score margins for DeepSeek V3 and LFM2.5-VL-1.6B-Extract
CategoryDeepSeek V3ΔLFM2.5-VL-1.6B-Extract
CodingDeepSeek V338.9MarginNo overlapLFM2.5-VL-1.6B-ExtractNot measured
KnowledgeDeepSeek V372.7MarginNo overlapLFM2.5-VL-1.6B-ExtractNot measured
MathDeepSeek V31.7MarginNo overlapLFM2.5-VL-1.6B-ExtractNot measured
Inst. FollowingDeepSeek V386.1MarginNo overlapLFM2.5-VL-1.6B-ExtractNot measured

Operational comparison

Runtime and commercial metrics are compared only when both models have a complete sourced value.

MetricDeepSeek V3LFM2.5-VL-1.6B-ExtractComparison
Input / output priceUSD per 1M tokensDeepSeek V3$0.27 input / $1.1 outputLFM2.5-VL-1.6B-ExtractNot availableA complete price comparison is not available.
Generation speedtokens per secondDeepSeek V3Not availableLFM2.5-VL-1.6B-ExtractNot availableA complete speed comparison is not available.
First-answer latencyseconds to first tokenDeepSeek V3Not availableLFM2.5-VL-1.6B-ExtractNot availableA complete latency comparison is not available.
Context windowmaximum listed tokensDeepSeek V3128KLFM2.5-VL-1.6B-Extract128KListed context windows are equal.

Benchmark Deep Dive

Agentic
BenchmarkDeepSeek V3LFM2.5-VL-1.6B-ExtractResult
AA Agentic IndexSource 1.6%Not comparable
τ²-bench resultsSource 22.8%8.5%DeepSeek V3 leads
GDPval-AASource 0.0%Not comparable
GDPval-AASource 217Not comparable
Coding
BenchmarkDeepSeek V3LFM2.5-VL-1.6B-ExtractResult
LiveCodeBenchSource 37.6%Not comparable
SWE-bench VerifiedSource 42%Not comparable
AA Coding IndexSource 23.0%Not comparable
AA-SciCodeSource 35.4%3.0%DeepSeek V3 leads
Reasoning
BenchmarkDeepSeek V3LFM2.5-VL-1.6B-ExtractResult
AA-LCRSource 29.0%0.0%DeepSeek V3 leads
CritPtSource 0.0%0.0%Tie
Knowledge
BenchmarkDeepSeek V3LFM2.5-VL-1.6B-ExtractResult
GPQASource 59.1%Not comparable
MMLU-ProSource 75.9%Not comparable
Artificial Analysis Intelligence IndexSource 14.2%1.0%DeepSeek V3 leads
AA-GPQA DiamondSource 55.7%28.9%DeepSeek V3 leads
AA-HLESource 3.6%5.1%LFM2.5-VL-1.6B-Extract leads
AA-Omniscience IndexSource -41.3%-83.9%DeepSeek V3 leads
AA-Omniscience AccuracySource 25.4%5.2%DeepSeek V3 leads
AA-Omniscience Hallucination RateSource 89.4%94.0%DeepSeek V3 leads
Math
BenchmarkDeepSeek V3LFM2.5-VL-1.6B-ExtractResult
FrontierMath v2 (Tiers 1-3)Source 1.724%Not comparable
Multimodal
BenchmarkDeepSeek V3LFM2.5-VL-1.6B-ExtractResult
Design Arena WebsiteSource 1150Not comparable
Liquid Extract JSON ValiditySource 99.6%Not comparable
Liquid Extract F1Source 99.6%Not comparable
Liquid Extract VLM JudgeSource 90.6%Not comparable
AA-MMMU-ProSource 26.5%Not comparable
Inst. Following
BenchmarkDeepSeek V3LFM2.5-VL-1.6B-ExtractResult
IFEvalSource 86.1%Not comparable
AA-IFBenchSource 34.8%33.1%DeepSeek V3 leads
Frequently Asked Questions (3)

Can I compare DeepSeek V3 and LFM2.5-VL-1.6B-Extract on BenchLM yet?

Not fully yet. BenchLM is tracking both models, but the sourced benchmark breakdown for this comparison is still coming soon.

Why does this comparison show “coming soon”?

BenchLM only shows category winners and benchmark-level calls when we have sourced results that can be compared fairly. For these models, the public benchmark coverage is not complete enough yet.

What data is available for DeepSeek V3 and LFM2.5-VL-1.6B-Extract today?

DeepSeek V3: $0.27 input / $1.10 output per 1M tokens Both model pages still include creator, context window, reasoning mode, and other metadata while benchmark coverage fills in.

Self-host vs API cost

Estimates at 50,000 req/day · 1000 tokens/req average.

DeepSeek V3
API / mo$1,028
Self-host / mo$18,221
Break-even1.2B/day
LFM2.5-VL-1.6B-Extract
API / mo$0
Self-host / moNot listed
Break-even
Proprietary model — self-hosting not applicable.
Model the full break-even

Related Comparisons

Last updated: July 23, 2026

Choose a model with this week’s evidence

Join 2,000+ readers for ranking moves, pricing changes, and the claims that still need proof.

One email each week. Unsubscribe anytime.