Side-by-side benchmark comparison across agentic, coding, multimodal, knowledge, reasoning, and math workflows.
Mistral 7B v0.3 has the cleaner overall profile here, landing at 32 versus 30. It is a real lead, but still close enough that category-level strengths matter more than the headline number.
Mistral 7B v0.3's sharpest advantage is in mathematics, where it averages 43 against 37. The single biggest benchmark swing on the page is IFEval, 68 to 80. LFM2.5-1.2B-Instruct does hit back in instruction following, so the answer changes if that is the part of the workload you care about most.
Pick Mistral 7B v0.3 if you want the stronger benchmark profile. LFM2.5-1.2B-Instruct only becomes the better choice if instruction following is the priority.
Mistral 7B v0.3
26.4
LFM2.5-1.2B-Instruct
25.7
Mistral 7B v0.3
13.2
LFM2.5-1.2B-Instruct
7.2
Mistral 7B v0.3
32.4
LFM2.5-1.2B-Instruct
32.4
Mistral 7B v0.3
36.1
LFM2.5-1.2B-Instruct
32.1
Mistral 7B v0.3
30
LFM2.5-1.2B-Instruct
26
Mistral 7B v0.3
68
LFM2.5-1.2B-Instruct
80
Mistral 7B v0.3
60.7
LFM2.5-1.2B-Instruct
60.7
Mistral 7B v0.3
43
LFM2.5-1.2B-Instruct
37
Mistral 7B v0.3 is ahead overall, 32 to 30. The biggest single separator in this matchup is IFEval, where the scores are 68 and 80.
Mistral 7B v0.3 has the edge for knowledge tasks in this comparison, averaging 30 versus 26. Inside this category, MMLU is the benchmark that creates the most daylight between them.
Mistral 7B v0.3 has the edge for coding in this comparison, averaging 13.2 versus 7.2. Inside this category, HumanEval is the benchmark that creates the most daylight between them.
Mistral 7B v0.3 has the edge for math in this comparison, averaging 43 versus 37. Inside this category, AIME 2023 is the benchmark that creates the most daylight between them.
Mistral 7B v0.3 has the edge for reasoning in this comparison, averaging 36.1 versus 32.1. Inside this category, SimpleQA is the benchmark that creates the most daylight between them.
Mistral 7B v0.3 has the edge for agentic tasks in this comparison, averaging 26.4 versus 25.7. Inside this category, Terminal-Bench 2.0 is the benchmark that creates the most daylight between them.
Mistral 7B v0.3 and LFM2.5-1.2B-Instruct are effectively tied for multimodal and grounded tasks here, both landing at 32.4 on average.
LFM2.5-1.2B-Instruct has the edge for instruction following in this comparison, averaging 80 versus 68. Inside this category, IFEval is the benchmark that creates the most daylight between them.
Mistral 7B v0.3 and LFM2.5-1.2B-Instruct are effectively tied for multilingual tasks here, both landing at 60.7 on average.
Get notified when new models drop, benchmark scores change, or the leaderboard shifts. One email per week.
Free. No spam. Unsubscribe anytime. We only store derived location metadata for consent routing.