A.X series vs Claude 3 Haiku

Side-by-side benchmark comparison across agentic, coding, multimodal, knowledge, reasoning, and math workflows.

Benchmark data for one or both models is coming soon. This page currently shows metadata and pricing where BenchLM has it, and score-level comparisons will populate as public benchmark results land.

BenchLM does not have sourced benchmark coverage for A.X series yet. This comparison is currently limited to metadata such as context window, reasoning mode, and pricing where available.

Claude 3 Haiku has the larger context window at 200K, compared with 64K for A.X series.

Quick Verdict

Benchmark data for A.X series and Claude 3 Haiku is coming soon on BenchLM.

Agentic

Coming soon

Comparable scores for this category are coming soon. One or both models do not have sourced results here yet.

Coming soon
Terminal-Bench 2.0
40%
Coming soon
BrowseComp
53%

Coding

Coming soon

Comparable scores for this category are coming soon. One or both models do not have sourced results here yet.

Coming soon
HumanEval
73%
Coming soon
SWE-bench Verified
17%
Coming soon
LiveCodeBench
20%
Coming soon
SWE-bench Pro
19%

Multimodal & Grounded

Coming soon

Comparable scores for this category are coming soon. One or both models do not have sourced results here yet.

Coming soon
MMMU-Pro
70%

Reasoning

Coming soon

Comparable scores for this category are coming soon. One or both models do not have sourced results here yet.

Coming soon
MuSR
52%
Coming soon
BBH
74%
Coming soon
LongBench v2
63%
Coming soon
MRCRv2
63%

Knowledge

Coming soon

Comparable scores for this category are coming soon. One or both models do not have sourced results here yet.

Coming soon
MMLU
75.2%
Coming soon
GPQA
56%
Coming soon
SuperGPQA
54%
Coming soon
MMLU-Pro
63%
Coming soon
HLE
2%
Coming soon
FrontierScience
50%
Coming soon
SimpleQA
54%

Instruction Following

Coming soon

Comparable scores for this category are coming soon. One or both models do not have sourced results here yet.

Coming soon
IFEval
76%

Multilingual

Coming soon

Comparable scores for this category are coming soon. One or both models do not have sourced results here yet.

Coming soon
MGSM
73%
Coming soon
MMLU-ProX
70%

Mathematics

Coming soon

Comparable scores for this category are coming soon. One or both models do not have sourced results here yet.

Coming soon
AIME 2023
56%
Coming soon
AIME 2024
58%
Coming soon
AIME 2025
57%
Coming soon
HMMT Feb 2023
52%
Coming soon
HMMT Feb 2024
54%
Coming soon
HMMT Feb 2025
53%
Coming soon
BRUMO 2025
55%
Coming soon
MATH-500
71%

Frequently Asked Questions

Can I compare A.X series and Claude 3 Haiku on BenchLM yet?

Not fully yet. BenchLM is tracking both models, but the sourced benchmark breakdown for this comparison is still coming soon.

Why does this comparison show “coming soon”?

BenchLM only shows category winners and benchmark-level calls when we have sourced results that can be compared fairly. For these models, the public benchmark coverage is not complete enough yet.

What data is available for A.X series and Claude 3 Haiku today?

Claude 3 Haiku: Pricing unavailable Both model pages still include creator, context window, reasoning mode, and other metadata while benchmark coverage fills in.

Last updated: March 18, 2026

Weekly LLM Benchmark Digest

Get notified when new models drop, benchmark scores change, or the leaderboard shifts. One email per week.

Free. No spam. Unsubscribe anytime. We only store derived location metadata for consent routing.