Head-to-head comparison across 0benchmark categories. Overall scores shown here use BenchLM's provisional ranking lane.
1-bit Bonsai 4B
--
Claude 3 Haiku
--
Benchmark data for 1-bit Bonsai 4B and Claude 3 Haiku is coming soon on BenchLM.
1-bit Bonsai 4B
Claude 3 Haiku
$0 / $0
$0.25 / $1.25
N/A
138 t/s
N/A
1.16s
32K
200K
Benchmark data for 1-bit Bonsai 4B and Claude 3 Haiku is coming soon on BenchLM.
BenchLM does not have sourced benchmark coverage for 1-bit Bonsai 4B and Claude 3 Haiku yet. This comparison is currently limited to metadata such as context window, reasoning mode, and pricing where available.
Claude 3 Haiku is priced at $0.25 input / $1.25 output per 1M tokens, versus $0.00 input / $0.00 output per 1M tokens for 1-bit Bonsai 4B. Claude 3 Haiku has the larger context window at 200K, compared with 32K for 1-bit Bonsai 4B.
Not fully yet. BenchLM is tracking both models, but the sourced benchmark breakdown for this comparison is still coming soon.
BenchLM only shows category winners and benchmark-level calls when we have sourced results that can be compared fairly. For these models, the public benchmark coverage is not complete enough yet.
1-bit Bonsai 4B: $0.00 input / $0.00 output per 1M tokens Claude 3 Haiku: $0.25 input / $1.25 output per 1M tokens Both model pages still include creator, context window, reasoning mode, and other metadata while benchmark coverage fills in.
For engineers, researchers, and the plain curious — a weekly brief on new models, ranking shifts, and pricing changes.
Free. No spam. Unsubscribe anytime.