Claude 3 Haiku
According to BenchLM.ai, Claude 3 Haiku ranks #107 out of 119 models on the provisional leaderboard with an overall score of 23/100. It does not yet have enough sourced coverage for BenchLM's verified leaderboard. While not a frontier model, it offers specific advantages depending on the use case.
Claude 3 Haiku is a proprietary model with a 200K token context window. It processes queries without explicit chain-of-thought reasoning, offering faster response times and lower token usage.
This profile currently has 17 of 225 tracked benchmarks. BenchLM only exposes non-generated benchmark rows publicly, so missing categories stay blank until a sourced evaluation is available.
Its strongest category is Multimodal & Grounded (#60), while its weakest is Instruction Following (#103). This performance profile makes it particularly strong for screenshots, documents, charts, and grounded multimodal workflows.
Ranking Distribution
Category rank across 8 benchmark categories — sorted by best rank
Category Performance
Scores across all benchmark categories (0-100 scale)
Category Breakdown
Agentic
#85Coding
#91Reasoning
#65Knowledge
#89Math
#66Multilingual
#69Multimodal
#60Inst. Following
#103Chatbot Arena Performance
Benchmark Details
Only benchmark rows with an attached exact-source record are shown here. Source-unverified manual rows and generated rows are hidden from model pages.
Compare This Model
See how Claude 3 Haiku stacks up against similar models
Frequently Asked Questions
How does Claude 3 Haiku perform overall in AI benchmarks?
Claude 3 Haiku currently ranks #107 out of 119 models on BenchLM's provisional leaderboard with an overall score of 23 (estimated). It is created by Anthropic and features a 200K context window.
Is Claude 3 Haiku good for knowledge and understanding?
Claude 3 Haiku ranks #89 out of 119 models in knowledge and understanding benchmarks with an average score of 25.4. There are stronger options in this category.
Is Claude 3 Haiku good for coding and programming?
Claude 3 Haiku ranks #91 out of 119 models in coding and programming benchmarks with an average score of 8.1. There are stronger options in this category.
Is Claude 3 Haiku good for reasoning and logic?
Claude 3 Haiku ranks #65 out of 119 models in reasoning and logic benchmarks with an average score of 37.1. There are stronger options in this category.
Is Claude 3 Haiku good for agentic tool use and computer tasks?
Claude 3 Haiku ranks #85 out of 119 models in agentic tool use and computer tasks benchmarks with an average score of 18.5. There are stronger options in this category.
Is Claude 3 Haiku good for multimodal and grounded tasks?
Claude 3 Haiku ranks #60 out of 119 models in multimodal and grounded tasks benchmarks with an average score of 55.2. There are stronger options in this category.
Is Claude 3 Haiku good for instruction following?
Claude 3 Haiku ranks #103 out of 119 models in instruction following benchmarks with an average score of 33. There are stronger options in this category.
Does Claude 3 Haiku have full benchmark coverage on BenchLM?
Not yet. Claude 3 Haiku currently has 17 published benchmark scores out of the 225 benchmarks BenchLM tracks. BenchLM only exposes non-generated public benchmark rows, so missing categories stay blank until a sourced evaluation is available.
What is the context window size of Claude 3 Haiku?
Claude 3 Haiku has a context window of 200K, which determines how much text it can process in a single interaction.
Related Resources
Don't miss the next GPT moment
Which models moved up, what’s new, and what it costs. One email a week, 3-min read.
Free. One email per week.