GDP.pdf task-macro rubric pass rate with Python, Gemini judge (GDP.pdf w/ Python (Gemini judge))
We show this table for reference; we do not rank on it.
Professional document understanding where the model receives each original PDF in a sandbox with an IPython tool.
Benchmark score on GDP.pdf w/ Python (Gemini judge) — October 29, 2026
We compile the GDP.pdf w/ Python (Gemini judge) rows from provider self-reports. Kimi K3.1 Pro leads the table at 85.7%. We do not use these results to rank models overall.
1 modelMultimodal & GroundedCurrentDisplay onlyUpdated October 29, 2026
Benchmark score table (1 model)
| Rank | Model / configuration | Score | Parameters (B) | Open / closed |
|---|---|---|---|---|
| 1 | Kimi K3.1 ProMoonshot AI | 85.7% | Not reported | Pending |
About GDP.pdf w/ Python (Gemini judge)
Year
2026
Tasks
Professional document prompts with Python
Format
Mean rubric pass rate
Difficulty
Tool-assisted document reasoning
Moonshot grades each rubric criterion with Gemini-3.5-Flash at medium effort using the official judging prompt and reports the task-macro mean rubric pass rate over five runs. The judge and tool setup differ from Anthropic's GDP.pdf tools row, so BenchLM keeps this protocol on its own key.
Freshness and provenance
Version
GDP.pdf w/ Python (Gemini judge) 2026
Refresh cadence
Quarterly
Staleness state
Current
Question availability
Public benchmark set
BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.
Questions
What does GDP.pdf w/ Python (Gemini judge) measure?
Professional document understanding where the model receives each original PDF in a sandbox with an IPython tool.
Which model scores highest on GDP.pdf w/ Python (Gemini judge)?
Kimi K3.1 Pro by Moonshot AI currently leads with a score of 85.7% on GDP.pdf w/ Python (Gemini judge).
How many models are evaluated on GDP.pdf w/ Python (Gemini judge)?
1 AI models have published results on GDP.pdf w/ Python (Gemini judge) in the BenchLM catalog.
Know when it’s worth switching models
The model to choose, the cheaper alternative, and the release we would wait on.
Read a sample issueJoin 6,100+ subscribers.
One email each week. Unsubscribe anytime.