Skip to main content

MStar

A general visual question-answering benchmark used in provider tables for real-image reasoning quality.

How BenchLM shows MStar right now

BenchLM is tracking MStar in the local dataset, but exact-source verification records for these rows are still being attached. To avoid a blank benchmark page, BenchLM shows the current tracked rows below as a display-only reference table.

These tracked rows are useful for inspection and spot-checking, but until exact-source attachments are completed they should not be treated as fully verified public benchmark rows.

6 tracked modelsLocal tracked rowsAwaiting exact-source attachmentsDisplay only

Tracked score on MStar — April 10, 2026

BenchLM mirrors the published tracked score view for MStar. Qwen3.5 397B leads the public snapshot at 83.8% , followed by Qwen3.6 Plus (83.3%) and Gemini 3 Pro (83.1%). BenchLM does not use these results to rank models overall.

6 modelsMultimodal & GroundedCurrentDisplay onlyUpdated April 10, 2026

The published MStar snapshot is tightly clustered at the top: Qwen3.5 397B sits at 83.8%, while the third row is only 0.7 points behind. The broader top-10 spread is 10.6 points, so the benchmark still separates strong models even when the leaders cluster.

6 models have been evaluated on MStar. The benchmark falls in the Multimodal & Grounded category. This category carries a 12% weight in BenchLM.ai's overall scoring system. MStar is currently displayed for reference but excluded from the scoring formula, so it does not directly affect overall rankings.

About MStar

Year

2026

Tasks

Real-image visual QA

Format

Image-grounded QA

Difficulty

General visual reasoning

MStar sits between broad multimodal reasoning and grounded VQA. It is useful for checking whether a model can answer real-image questions without the stronger domain structure of office or academic benchmarks.

BenchLM freshness & provenance

Version

MStar 2026

Refresh cadence

Quarterly

Staleness state

Current

Question availability

Public benchmark set

CurrentDisplay only

BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.

Tracked score table (6 models)

1
Qwen3.5 397Bqwen3-5-397b
83.8%
2
Qwen3.6 Plusqwen3-6-plus
83.3%
3
Gemini 3 Progemini-3-pro
83.1%
4
Kimi K2.5kimi-k2-5
80.5%
5
GPT-5.2gpt-5-2
77.1%
6
Claude Opus 4.5claude-opus-4-5
73.2%

FAQ

What does MStar measure?

A general visual question-answering benchmark used in provider tables for real-image reasoning quality.

Which model leads the published MStar snapshot?

Qwen3.5 397B currently leads the published MStar snapshot with a tracked score of 83.8%. BenchLM shows this benchmark for display only and does not use it in overall rankings.

How many models are evaluated on MStar?

6 AI models are included in BenchLM's mirrored MStar snapshot, based on the public leaderboard captured on April 10, 2026.

Last updated: April 10, 2026 · mirrored from the public benchmark leaderboard

The AI models change fast. We track them for you.

For engineers, researchers, and the plain curious — a weekly brief on new models, ranking shifts, and pricing changes.

Free. No spam. Unsubscribe anytime.