Claude Sonnet 4.5 vs LFM2-24B-A2B

Side-by-side benchmark comparison across agentic, coding, multimodal, knowledge, reasoning, and math workflows.

Claude Sonnet 4.5 is clearly ahead on the aggregate, 76 to 38. The gap is large enough that you do not need to squint at the spreadsheet to see the difference.

Claude Sonnet 4.5's sharpest advantage is in multimodal & grounded, where it averages 91.4 against 41.7. The single biggest benchmark swing on the page is MMMU-Pro, 95 to 39.

Claude Sonnet 4.5 is also the more expensive model on tokens at $3.00 input / $15.00 output per 1M tokens, versus $0.03 input / $0.12 output per 1M tokens for LFM2-24B-A2B. That is roughly 125.0x on output cost alone. Claude Sonnet 4.5 gives you the larger context window at 200K, compared with 32K for LFM2-24B-A2B.

Quick Verdict

Pick Claude Sonnet 4.5 if you want the stronger benchmark profile. LFM2-24B-A2B only becomes the better choice if you want the cheaper token bill.

Agentic

Claude Sonnet 4.5

Claude Sonnet 4.5

70.3

LFM2-24B-A2B

33.4

69
Terminal-Bench 2.0
30
74
BrowseComp
38
69
OSWorld-Verified
34

Coding

Claude Sonnet 4.5

Claude Sonnet 4.5

57.5

LFM2-24B-A2B

18

87
HumanEval
42
66
SWE-bench Verified
18
53
LiveCodeBench
17
60
SWE-bench Pro
19

Multimodal & Grounded

Claude Sonnet 4.5

Claude Sonnet 4.5

91.4

LFM2-24B-A2B

41.7

95
MMMU-Pro
39
87
OfficeQA Pro
45

Reasoning

Claude Sonnet 4.5

Claude Sonnet 4.5

86

LFM2-24B-A2B

46.6

91
SimpleQA
44
89
MuSR
42
88
BBH
63
82
LongBench v2
48
81
MRCRv2
45

Knowledge

Claude Sonnet 4.5

Claude Sonnet 4.5

70.7

LFM2-24B-A2B

35.6

95
MMLU
46
93
GPQA
45
91
SuperGPQA
43
89
OpenBookQA
41
84
MMLU-Pro
51
21
HLE
4
84
FrontierScience
43

Instruction Following

Claude Sonnet 4.5

Claude Sonnet 4.5

90

LFM2-24B-A2B

68

90
IFEval
68

Multilingual

Claude Sonnet 4.5

Claude Sonnet 4.5

88.4

LFM2-24B-A2B

61.4

91
MGSM
64
87
MMLU-ProX
60

Mathematics

Claude Sonnet 4.5

Claude Sonnet 4.5

92.4

LFM2-24B-A2B

50.4

97
AIME 2023
46
99
AIME 2024
48
98
AIME 2025
47
93
HMMT Feb 2023
42
95
HMMT Feb 2024
44
94
HMMT Feb 2025
43
96
BRUMO 2025
45
88
MATH-500
57

Frequently Asked Questions

Which is better, Claude Sonnet 4.5 or LFM2-24B-A2B?

Claude Sonnet 4.5 is ahead overall, 76 to 38. The biggest single separator in this matchup is MMMU-Pro, where the scores are 95 and 39.

Which is better for knowledge tasks, Claude Sonnet 4.5 or LFM2-24B-A2B?

Claude Sonnet 4.5 has the edge for knowledge tasks in this comparison, averaging 70.7 versus 35.6. Inside this category, MMLU is the benchmark that creates the most daylight between them.

Which is better for coding, Claude Sonnet 4.5 or LFM2-24B-A2B?

Claude Sonnet 4.5 has the edge for coding in this comparison, averaging 57.5 versus 18. Inside this category, SWE-bench Verified is the benchmark that creates the most daylight between them.

Which is better for math, Claude Sonnet 4.5 or LFM2-24B-A2B?

Claude Sonnet 4.5 has the edge for math in this comparison, averaging 92.4 versus 50.4. Inside this category, AIME 2023 is the benchmark that creates the most daylight between them.

Which is better for reasoning, Claude Sonnet 4.5 or LFM2-24B-A2B?

Claude Sonnet 4.5 has the edge for reasoning in this comparison, averaging 86 versus 46.6. Inside this category, SimpleQA is the benchmark that creates the most daylight between them.

Which is better for agentic tasks, Claude Sonnet 4.5 or LFM2-24B-A2B?

Claude Sonnet 4.5 has the edge for agentic tasks in this comparison, averaging 70.3 versus 33.4. Inside this category, Terminal-Bench 2.0 is the benchmark that creates the most daylight between them.

Which is better for multimodal and grounded tasks, Claude Sonnet 4.5 or LFM2-24B-A2B?

Claude Sonnet 4.5 has the edge for multimodal and grounded tasks in this comparison, averaging 91.4 versus 41.7. Inside this category, MMMU-Pro is the benchmark that creates the most daylight between them.

Which is better for instruction following, Claude Sonnet 4.5 or LFM2-24B-A2B?

Claude Sonnet 4.5 has the edge for instruction following in this comparison, averaging 90 versus 68. Inside this category, IFEval is the benchmark that creates the most daylight between them.

Which is better for multilingual tasks, Claude Sonnet 4.5 or LFM2-24B-A2B?

Claude Sonnet 4.5 has the edge for multilingual tasks in this comparison, averaging 88.4 versus 61.4. Inside this category, MGSM is the benchmark that creates the most daylight between them.

Last updated: March 12, 2026

Weekly LLM Benchmark Digest

Get notified when new models drop, benchmark scores change, or the leaderboard shifts. One email per week.

Free. No spam. Unsubscribe anytime. We only store derived location metadata for consent routing.