Benchmark profile
ProtocolQA Open-Ended
An open-ended adaptation of laboratory-protocol troubleshooting questions.
Data verified 26 confirmed releases in the last 30 daysStart free briefBenchmark score on ProtocolQA Open-Ended — August 12, 2026
BenchLM mirrors the published score view for ProtocolQA Open-Ended. Grok 4.5 leads the public snapshot at 87.0% , followed by Grok 4.6 (79.6%). We do not use these results to rank models overall.
Grok 4.5
xAI
grok-4-5
Grok 4.6
xAI
grok-4-6
About ProtocolQA Open-Ended
Year
2026
Tasks
Laboratory-protocol troubleshooting questions
Format
Open-ended accuracy
Difficulty
Professional wet-lab troubleshooting
OpenAI publishes the evaluation design and results for its implementation. BenchLM keeps xAI's comparison rows display-only because the model-card protocol may not match every provider run.
BenchLM freshness & provenance
Version
ProtocolQA Open-Ended 2026
Refresh cadence
Quarterly
Staleness state
Current
Question availability
Public benchmark set
BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.
FAQ
What does ProtocolQA Open-Ended measure?
An open-ended adaptation of laboratory-protocol troubleshooting questions.
Which model scores highest on ProtocolQA Open-Ended?
Grok 4.5 by xAI currently leads with a score of 87.0% on ProtocolQA Open-Ended.
How many models are evaluated on ProtocolQA Open-Ended?
2 AI models have been evaluated on ProtocolQA Open-Ended on BenchLM.
Compare Top Models on ProtocolQA Open-Ended
Know when it’s worth switching models
The model to choose, the cheaper alternative, and the release we would wait on.
Read a sample issueJoin 2,000+ readers.
One email each week. Unsubscribe anytime.