A visual question answering benchmark focused on straightforward image-grounded understanding.
BenchLM mirrors the published score view for SimpleVQA. Qwen3.7 Plus leads the public snapshot at 81.7% , followed by Step 3.7 Flash (79.2%) and Gemini 3.1 Pro (72.4%). BenchLM does not use these results to rank models overall.
Qwen3.7 Plus
Alibaba
Step 3.7 Flash
StepFun
Gemini 3.1 Pro
The published SimpleVQA snapshot is tightly clustered at the top: Qwen3.7 Plus sits at 81.7%, while the third row is only 9.3 points behind. The broader top-10 spread is 25.6 points, so the benchmark still separates strong models even when the leaders cluster.
8 models have been evaluated on SimpleVQA. The benchmark falls in the Multimodal & Grounded category. This category carries a 12% weight in BenchLM.ai's overall scoring system. SimpleVQA is currently displayed for reference but excluded from the scoring formula, so it does not directly affect overall rankings.
Year
2026
Tasks
Visual QA tasks
Format
Image-grounded question answering
Difficulty
General visual understanding
BenchLM uses SimpleVQA as a display-only visual QA reference rather than a weighted multimodal ranking input.
Version
SimpleVQA 2026
Refresh cadence
Quarterly
Staleness state
Current
Question availability
Public benchmark set
BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.
A visual question answering benchmark focused on straightforward image-grounded understanding.
Qwen3.7 Plus by Alibaba currently leads with a score of 81.7% on SimpleVQA.
8 AI models have been evaluated on SimpleVQA on BenchLM.
For engineers, researchers, and the plain curious — a weekly brief on new models, ranking shifts, and pricing changes.
Free. No spam. Unsubscribe anytime.