BIG-Bench Hard (BBH)
A suite of 23 challenging tasks from the BIG-Bench collaborative benchmark where prior language models failed to exceed average human performance, even with chain-of-thought prompting.
Data verified 33 confirmed releases in the last 30 daysSee provider release alertsBenchmark score on BBH — September 15, 2026
We mirror the published score view for BBH. DeepSeek V4 Pro Base leads the public snapshot at 87.5%, followed by DeepSeek V4 Flash Base (86.9%) and Soofi S 30B-A3B (78.8%). We do not use these results to rank models overall.
DeepSeek V4 Pro Base
DeepSeek
DeepSeek V4 Flash Base
DeepSeek
Soofi S 30B-A3B
Soofi Project
5 modelsReasoningStaleSaturatedDisplay onlyUpdated September 15, 2026
Benchmark score table (5 models)
ScoreThe published BBH snapshot places DeepSeek V4 Pro Base first at 87.5%. The third row is 8.7 points behind. The broader top-10 range is 34.5 points, so the table still separates the published systems.
5 models have been evaluated on BBH. The benchmark falls in the Reasoning category. This category carries a 17% weight in BenchLM.ai's overall scoring system. BBH is currently displayed for reference but excluded from the scoring formula, so it does not directly affect overall rankings.
About BBH
Year
2022
Tasks
23 tasks
Format
Mixed reasoning tasks
Difficulty
Advanced reasoning
BBH focuses on 23 tasks from BIG-Bench that remain challenging for language models. Tasks include logical deduction, tracking shuffled objects, causal judgement, and other complex reasoning scenarios.
BenchLM freshness & provenance
Version
BBH 2022
Refresh cadence
Static
Staleness state
Stale
Question availability
Public benchmark set
BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.
FAQ
What does BBH measure?
A suite of 23 challenging tasks from the BIG-Bench collaborative benchmark where prior language models failed to exceed average human performance, even with chain-of-thought prompting.
Which model scores highest on BBH?
DeepSeek V4 Pro Base by DeepSeek currently leads with a score of 87.5% on BBH.
How many models are evaluated on BBH?
5 AI models have been evaluated on BBH on BenchLM.
Compare Top Models on BBH
Know when it’s worth switching models
The model to choose, the cheaper alternative, and the release we would wait on.
Read a sample issueJoin 2,000+ readers.
One email each week. Unsubscribe anytime.