Benchmark profile
OpenBookQA
A science question-answering benchmark that tests whether models can apply a small open-book set of elementary science facts to multi-step reasoning questions.
Data verifiedAbout OpenBookQA
Year
2018
Tasks
Elementary science questions
Format
4-way multiple choice
Difficulty
Elementary science reasoning
OpenBookQA was designed to test grounded science reasoning rather than pure memorization. Each question is paired with a core science fact, but models still need additional commonsense knowledge to infer the correct answer.
BenchLM freshness & provenance
Version
OpenBookQA 2018
Refresh cadence
Static
Staleness state
Stale
Question availability
Public benchmark set
BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.
FAQ
What does OpenBookQA measure?
A science question-answering benchmark that tests whether models can apply a small open-book set of elementary science facts to multi-step reasoning questions.
Which model scores highest on OpenBookQA?
No models have been evaluated on OpenBookQA yet.
How many models are evaluated on OpenBookQA?
0 AI models have been evaluated on OpenBookQA on BenchLM.
Know when it’s worth switching models
The model to choose, the cheaper alternative, and the release we would wait on.
Read a sample issueJoin 2,000+ readers.
One email each week. Unsubscribe anytime.