Benchmark profile
ZeroBench_main with Python (ZeroBench w/ Python)
A Python-assisted ZeroBench_main evaluation reported as pass@5.
Data verifiedBenchmark score on ZeroBench w/ Python — July 29, 2026
BenchLM mirrors the published score view for ZeroBench w/ Python. Kimi K3 leads the public snapshot at 41.0%. BenchLM does not use these results to rank models overall.
Benchmark score table (1 model)
ScoreAbout ZeroBench w/ Python
Year
2026
Tasks
Visual reasoning questions with Python
Format
Pass@5
Difficulty
Tool-augmented visual reasoning
Moonshot follows the official ZeroBench setting and runs it five times. BenchLM keeps this tool-assisted result separate from the non-Python ZeroBench key.
BenchLM freshness & provenance
Version
ZeroBench w/ Python 2026
Refresh cadence
Quarterly
Staleness state
Current
Question availability
Public benchmark set
BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.
FAQ
What does ZeroBench w/ Python measure?
A Python-assisted ZeroBench_main evaluation reported as pass@5.
Which model scores highest on ZeroBench w/ Python?
Kimi K3 by Moonshot AI currently leads with a score of 41.0% on ZeroBench w/ Python.
How many models are evaluated on ZeroBench w/ Python?
1 AI models have been evaluated on ZeroBench w/ Python on BenchLM.
Know when it’s worth switching models
The model to choose, the cheaper alternative, and the release we would wait on.
Read a sample issueJoin 2,000+ readers.
One email each week. Unsubscribe anytime.