Skip to main content
BenchLM

SimpleVQA

We show this table for reference; we do not rank on it.

Data verified 34 confirmed releases in the last 30 daysFollow model changes

A visual question answering benchmark focused on straightforward image-grounded understanding.

Benchmark score on SimpleVQA — September 27, 2026

We compile the SimpleVQA rows from provider self-reports and secondary reports. Qwen3.7 Plus leads the table at 81.7%, followed by Step 3.7 Flash (79.2%) and Qwen3.8 Max (75.0%). We do not use these results to rank models overall.

1Proprietary

Qwen3.7 Plus

Alibaba

81.7%
Overall 55.78Context 1M
2Open weights

Step 3.7 Flash

StepFun

79.2%
Overall 41.41Context 256K
3Open weights

Qwen3.8 Max

Alibaba

75.0%
Overall 71.8Context 1M

11 modelsMultimodal & GroundedCurrentDisplay onlyUpdated September 27, 2026

Benchmark score table (11 models)

Score
1
Qwen3.7 PlusAlibaba · Closed
81.7%
2
Step 3.7 FlashStepFun · Open weight
79.2%
3
Qwen3.8 MaxAlibaba · Open weight
75.0%
4
dots3-note PreviewDots Studio · Open weight
72.5%
5
Gemini 3.1 ProGoogle · Closed
72.4%
6
Muse SparkMeta · Closed
71.3%
7
GPT-5.4OpenAI · Closed
61.1%
8
Qwen3.6-35B-A3BAlibaba · Open weight
58.9%
9
Grok 4.20xAI · Closed
57.4%
10
Qwen3.6-27BAlibaba · Open weight
56.1%
11
LFM2.5-VL-3BLiquidAI · Open weight
35.4%

Among the reported SimpleVQA rows, Qwen3.7 Plus is first at 81.7%. The third row is 6.7 points behind. The broader top-10 range is 25.6 points, so the table still separates the published systems.

11 models have been evaluated on SimpleVQA. The benchmark falls in the Multimodal & Grounded category. SimpleVQA is currently displayed for reference but excluded from the scoring formula, so it does not directly affect overall rankings.

About SimpleVQA

Year

2026

Tasks

Visual QA tasks

Format

Image-grounded question answering

Difficulty

General visual understanding

BenchLM uses SimpleVQA as a display-only visual QA reference rather than a weighted multimodal ranking input.

GLM-5V-Turbo

Freshness and provenance

Version

SimpleVQA 2026

Refresh cadence

Quarterly

Staleness state

Current

Question availability

Public benchmark set

CurrentDisplay only

BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.

Questions

What does SimpleVQA measure?

A visual question answering benchmark focused on straightforward image-grounded understanding.

Which model scores highest on SimpleVQA?

Qwen3.7 Plus by Alibaba currently leads with a score of 81.7% on SimpleVQA.

How many models are evaluated on SimpleVQA?

11 AI models have been evaluated on SimpleVQA on BenchLM.

Compare top models on SimpleVQA

Qwen3.7 Plus vs Step 3.7 FlashStep 3.7 Flash vs Qwen3.8 MaxQwen3.8 Max vs dots3-note Previewdots3-note Preview vs Gemini 3.1 Pro
Last updated: September 27, 2026 · BenchLM version SimpleVQA 2026

Know when it’s worth switching models

The model to choose, the cheaper alternative, and the release we would wait on.

Read a sample issue

Join 2,000+ readers.

One email each week. Unsubscribe anytime.