Benchmark profile
BIG-Bench Hard (BBH)
A suite of 23 challenging tasks from the BIG-Bench collaborative benchmark where prior language models failed to exceed average human performance, even with chain-of-thought prompting.
Data verifiedBenchmark score on BBH — July 20, 2026
BenchLM mirrors the published score view for BBH. DeepSeek V4 Pro Base leads the public snapshot at 87.5% , followed by DeepSeek V4 Flash Base (86.9%) and Soofi S 30B-A3B (78.8%). BenchLM does not use these results to rank models overall.
DeepSeek V4 Pro Base
DeepSeek
deepseek-v4-pro-base
DeepSeek V4 Flash Base
DeepSeek
deepseek-v4-flash-base
Soofi S 30B-A3B
Soofi Project
soofi-s-30b-a3b
Benchmark score table (5 models)
ScoreThe published BBH snapshot places DeepSeek V4 Pro Base first at 87.5%. The third row is 8.7 points behind. The broader top-10 range is 34.5 points, so the table still separates the published systems.
5 models have been evaluated on BBH. The benchmark falls in the Reasoning category. This category carries a 17% weight in BenchLM.ai's overall scoring system. BBH is currently displayed for reference but excluded from the scoring formula, so it does not directly affect overall rankings.
About BBH
Year
2022
Tasks
23 tasks
Format
Mixed reasoning tasks
Difficulty
Advanced reasoning
BBH focuses on 23 tasks from BIG-Bench that remain challenging for language models. Tasks include logical deduction, tracking shuffled objects, causal judgement, and other complex reasoning scenarios.
BenchLM freshness & provenance
Version
BBH 2022
Refresh cadence
Static
Staleness state
Stale
Question availability
Public benchmark set
BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.
FAQ
What does BBH measure?
A suite of 23 challenging tasks from the BIG-Bench collaborative benchmark where prior language models failed to exceed average human performance, even with chain-of-thought prompting.
Which model scores highest on BBH?
DeepSeek V4 Pro Base by DeepSeek currently leads with a score of 87.5% on BBH.
How many models are evaluated on BBH?
5 AI models have been evaluated on BBH on BenchLM.
Choose a model with this week’s evidence
Join 2,000+ readers for ranking moves, pricing changes, and the claims that still need proof.
One email each week. Unsubscribe anytime.