Capability
Unranked
field median 56.2
Not eligible for a public rank
LFM2.5-VL-3B
Released Aug 12, 2026 — see all recent releases
Decision reading
LFM2.5-VL-3B is tracked, but not publicly ranked yet. The profile exposes 10 sourced benchmark rows and leaves unsupported fields blank until a published record exists.
Data as of September 10, 2026 · How the score is built
Share or export
Strongest published evidence
Published rows are visible, but no category has enough eligible evidence for a comparative rank.
Validate before choosing
10 published rows leave some tracked benchmark slots empty. No comparable first-party API token rate is published.
Decision snapshot
Each value carries a field reference instead of floating alone. Markers compare this model with the current ranked and priced catalog; they are not absolute quality thresholds.
Price
Self-hosted; infrastructure cost varies
input median $1
No comparable first-party hosted token rate
Speed
Not measured
field median 86.5 tok/s
Time to first token not measured
Context
32Ktokens
field median 256,000
Maximum output length is tracked separately
How much of this is verified
Coverage is split by category so a strong number never hides a thin evidence base. Verified means the row is tied to a published source; provisional rows remain visible but separate.
- Agentic1/1 verified
- CodingNot measured
- ReasoningNot measured
- KnowledgeNot measured
- MathNot measured
- MultilingualNot measured
- Multimodal7/7 verified
- Inst. Following2/2 verified
Verified sourceProvisionalNot measured
Spec sheet
Each documented value carries its source. Missing fields stay visible as not sourced or not published, rather than disappearing from the page.
- API model ID
- LiquidAI/LFM2.5-VL-3BLiquid AI LFM2.5-VL-3B model card
- Context window
- 32KLiquid AI LFM2.5-VL-3B model card
- Maximum output
- Not sourced yet
- Knowledge cutoff
- Not sourced yet
- Input modalities
- Not sourced yet
- Output modalities
- Not sourced yet
- Parameters
- Not sourced yet
- Availability
- Liquid AI publishes the 3.1B vision-language model (built on LFM2.5-2.6B-Base) under the LFM Open License v1.0 on Hugging Face with GGUF, ONNX, and MLX exports and a 32,768-token context.
- Cloud regions
- Not tracked yet
- Lifecycle
- Current
- API capabilities
- Tool calling, structured outputs, and batch support are not tracked yet
- Prompt caching
- Not documented in the pricing recordLiquid AI LFM2.5-VL-3B model card
- Self-host
- Open weights available; hardware estimate not sourced
- Rate limits
- Not tracked yet
Deployment options
Self-host and provider-specific paths stay separate from benchmark evidence so operating constraints are visible before a score becomes the whole decision.
Published weights are available, but BenchLM does not yet have a sourced parameter and VRAM profile for this exact model. Hardware cost estimates stay unavailable until that sizing record is complete.
Estimate VRAM from known parametersCategory score record
Scores and ranks appear only where published evidence can be displayed. The table keeps the score, weight, cohort, and evidence state together.
| Category | Score | Rank | Percentile | Weight | Benchmarks | Evidence |
|---|---|---|---|---|---|---|
| AgenticWeight 22%1 benchmarkVerified | Score pending | Not ranked | Not available | 22% | 1 benchmark | Verified |
| CodingWeight 20%0 benchmarksNot measured | Not measured | Not ranked | Not available | 20% | 0 benchmarks | Not measured |
| ReasoningWeight 17%0 benchmarksNot measured | Not measured | Not ranked | Not available | 17% | 0 benchmarks | Not measured |
| KnowledgeWeight 12%0 benchmarksNot measured | Not measured | Not ranked | Not available | 12% | 0 benchmarks | Not measured |
| MathWeight 5%0 benchmarksNot measured | Not measured | Not ranked | Not available | 5% | 0 benchmarks | Not measured |
| MultilingualWeight 7%0 benchmarksNot measured | Not measured | Not ranked | Not available | 7% | 0 benchmarks | Not measured |
| MultimodalRank Not rankedWeight 12%7 benchmarksVerified | 17.9 | Not ranked | Not available | 12% | 7 benchmarks | Verified |
| Inst. FollowingRank Not rankedWeight 5%2 benchmarksVerified | 9.7 | Not ranked | Not available | 5% | 2 benchmarks | Verified |
Benchmark ledger
Agentic opens by default. The marker compares each value with the best source-verified result in the catalog; provisional leaders do not set the reference. Expand the remaining categories for every published row.
Agentic1 row
| Benchmark | Score | Versus best verified row | Gap | Weight | Evidence |
|---|---|---|---|---|---|
| BFCL v4Berkeley Function Calling Leaderboard v4 | Score32.5% | Versus best verified row Best verified: BTL-3 · 88.5% | Gap56 behind | WeightDisplay only | Provider exact |
Multimodal7 rows
| Benchmark | Score | Versus best verified row | Gap | Weight | Evidence |
|---|---|---|---|---|---|
| MMMU-ProMassive Multi-discipline Multimodal Understanding Pro | Score30.5% | Versus best verified row Best verified: Gemini 3.5 Flash · 83.6% | Gap53.1 behind | WeightWeighted 40% | Provider exact |
| RealWorldQA | Score73.1% | Versus best verified row Best verified: Qwen3.8-Flash-Next · 88.5% | Gap15.4 behind | WeightDisplay only | Provider exact |
| SimpleVQA | Score35.4% | Versus best verified row Best verified: Qwen3.7 Plus · 81.7% | Gap46.3 behind | WeightDisplay only | Provider exact |
| CountBench | Score87.3% | Versus best verified row Best verified: Qwen3.6-27B · 97.8% | Gap10.5 behind | WeightDisplay only | Provider exact |
| MMMUMassive Multi-discipline Multimodal Understanding | Score48.4% | Versus best verified row Best verified: Qwen3.6-27B · 82.9% | Gap34.5 behind | WeightDisplay only | Provider exact |
| OCRBench V2 | Score47.5% | Versus best verified row Best verified: Qwen3.8 Max · 74.2% | Gap26.7 behind | WeightDisplay only | Provider exact |
| RefCOCO (avg)RefCOCO average | Score87.9% | Versus best verified row Best verified: Qwen3.6-27B · 92.5% | Gap4.6 behind | WeightDisplay only | Provider exact |
Inst. Following2 rows
| Benchmark | Score | Versus best verified row | Gap | Weight | Evidence |
|---|---|---|---|---|---|
| IFBenchInstruction Following Benchmark | Score25.8% | Versus best verified row Best verified: MAI-Thinking-1 · 85% | Gap59.2 behind | WeightWeighted 70% | Provider exact |
| IFEvalInstruction-Following Eval | Score82.3% | Versus best verified row Best verified: Qwen3.5-27B · 95% | Gap12.7 behind | WeightDisplay only | Provider exact |
Lineage
The sequence follows explicit supersedes links. A successor's displayed score stays at least 0.1 points above its predecessor; raw benchmark rows do not move. Scores and prices remain blank when the corresponding public row or first-party rate is unavailable.
Aug 12, 2026 · you are here
LFM2.5-VL-3BNot publicly ranked · Price not listed
Base entry
How to read this profile
The visual layer above carries the decisions. These notes preserve the model, ranking, coverage, and family context behind the numbers.
We track LFM2.5-VL-3B, but the public leaderboard excludes this profile until enough non-generated benchmark coverage is available. Only published rows appear above.
LFM2.5-VL-3B is a open weight model with a 32K context window. No explicit reasoning mode is documented in this profile.
Liquid AI publishes the 3.1B vision-language model (built on LFM2.5-2.6B-Base) under the LFM Open License v1.0 on Hugging Face with GGUF, ONNX, and MLX exports and a 32,768-token context.
Official exact-value snapshot from the LFM2.5-VL-3B Hugging Face model card and August 12, 2026 launch post. BenchLM maps RealWorldQA, SimpleVQA, CountBenchQA, MMMU (val), MMMU-Pro, OCRBench v2, RefCOCO average, IFEval, IFBench, and BFCL v4 onto existing lanes; MMStar, MME, SEED-Bench, MMBench, ChartQA, DocVQA, InfographicVQA, TextVQA, BLINK, MuirBench, HallusionBench, POPE, ScreenSpot-v2, Multi-IF, and ToolSandbox have no exact compatible lane. Provider-run rows keep the row unranked.
10 of 434 tracked benchmark slots currently have displayable evidence. Missing categories stay blank.
Radar
Full release historyLFM2.5-VL-3B release history
LFM2.5-VL-3B released
LiquidAI · Model release
Source confirmed
Radar confirmed these at the source. Use LFM2.5-VL-3B in your work? Explore Radar to follow supported changes and choose your alerts.
Frequently asked questions
How does LFM2.5-VL-3B perform overall in AI benchmarks?
LFM2.5-VL-3B has 10 source-displayable benchmark rows, but it does not qualify for a public overall rank. The available rows remain visible by category without being converted into a site-wide score. Missing evidence stays blank instead of being estimated from an earlier model.
Is LFM2.5-VL-3B good for agentic tool use and computer tasks?
LFM2.5-VL-3B has source-displayable benchmark coverage for agentic tool use and computer tasks, but the public category table does not assign it a rank there. The individual rows remain available for inspection. A missing category position means the evidence threshold was not met; it does not convert the model's unmeasured work into a zero.
Is LFM2.5-VL-3B good for multimodal and grounded tasks?
LFM2.5-VL-3B has source-displayable benchmark coverage for multimodal and grounded tasks, but the public category table does not assign it a rank there. The individual rows remain available for inspection. A missing category position means the evidence threshold was not met; it does not convert the model's unmeasured work into a zero.
Is LFM2.5-VL-3B good for instruction following?
LFM2.5-VL-3B has source-displayable benchmark coverage for instruction following, but the public category table does not assign it a rank there. The individual rows remain available for inspection. A missing category position means the evidence threshold was not met; it does not convert the model's unmeasured work into a zero.
Is LFM2.5-VL-3B open source?
LFM2.5-VL-3B is an open-weight model from LiquidAI. Its weights can be downloaded for local or hosted deployment, subject to the published license. Open weight does not automatically mean open source: training data and training code may remain private, and commercial restrictions can still apply.
Does LFM2.5-VL-3B have full benchmark coverage on BenchLM?
No. LFM2.5-VL-3B currently has 10 source-displayable rows across 434 tracked benchmark slots. The profile exposes published, non-generated evidence and leaves missing categories blank until an exact evaluation is available. Coverage describes how much was measured; it is not a penalty added to an individual benchmark result.
What is the context window size of LFM2.5-VL-3B?
LFM2.5-VL-3B has a documented context window of 32K. That figure is the maximum combined prompt and retained-conversation space reported for this exact model; it is not the maximum output length. The profile keeps output limits separate because providers often publish those limits independently.
Compare LFM2.5-VL-3B with every tracked model482 comparisons
Last updated September 10, 2026. Runtime fields remain blank until a sourced snapshot exists.
Watch LFM2.5-VL-3B in the weekly brief
Get one weekly email when material rank, price, availability, or benchmark evidence changes are worth revisiting.
Read a sample issueJoin 2,000+ readers.