Qwen3 235B 2507 vs LFM2.5-1.2B-Instruct

Side-by-side benchmark comparison across agentic, coding, multimodal, knowledge, reasoning, and math workflows.

Qwen3 235B 2507 is clearly ahead on the aggregate, 37 to 30. The gap is large enough that you do not need to squint at the spreadsheet to see the difference.

Qwen3 235B 2507's sharpest advantage is in reasoning, where it averages 45.6 against 32.1. The single biggest benchmark swing on the page is LongBench v2, 52 to 34. LFM2.5-1.2B-Instruct does hit back in instruction following, so the answer changes if that is the part of the workload you care about most.

Qwen3 235B 2507 gives you the larger context window at 128K, compared with 32K for LFM2.5-1.2B-Instruct.

Quick Verdict

Pick Qwen3 235B 2507 if you want the stronger benchmark profile. LFM2.5-1.2B-Instruct only becomes the better choice if instruction following is the priority.

Agentic

Qwen3 235B 2507

Qwen3 235B 2507

33.7

LFM2.5-1.2B-Instruct

25.7

33
Terminal-Bench 2.0
22
40
BrowseComp
31
30
OSWorld-Verified
26

Coding

Qwen3 235B 2507

Qwen3 235B 2507

14.6

LFM2.5-1.2B-Instruct

7.2

31
HumanEval
14
15
SWE-bench Verified
9
10
LiveCodeBench
8
19
SWE-bench Pro
6

Multimodal & Grounded

Qwen3 235B 2507

Qwen3 235B 2507

41.6

LFM2.5-1.2B-Instruct

32.4

38
MMMU-Pro
27
46
OfficeQA Pro
39

Reasoning

Qwen3 235B 2507

Qwen3 235B 2507

45.6

LFM2.5-1.2B-Instruct

32.1

37
SimpleQA
24
35
MuSR
22
60
BBH
59
52
LongBench v2
34
52
MRCRv2
37

Knowledge

Qwen3 235B 2507

Qwen3 235B 2507

31.9

LFM2.5-1.2B-Instruct

26

39
MMLU
26
38
GPQA
25
36
SuperGPQA
23
34
OpenBookQA
21
51
MMLU-Pro
50
1
HLE
1
39
FrontierScience
30

Instruction Following

LFM2.5-1.2B-Instruct

Qwen3 235B 2507

69

LFM2.5-1.2B-Instruct

80

69
IFEval
80

Multilingual

LFM2.5-1.2B-Instruct

Qwen3 235B 2507

60.4

LFM2.5-1.2B-Instruct

60.7

63
MGSM
62
59
MMLU-ProX
60

Mathematics

Qwen3 235B 2507

Qwen3 235B 2507

46.6

LFM2.5-1.2B-Instruct

37

39
AIME 2023
24
41
AIME 2024
26
40
AIME 2025
25
35
HMMT Feb 2023
20
37
HMMT Feb 2024
22
36
HMMT Feb 2025
21
38
BRUMO 2025
23
57
MATH-500
54

Frequently Asked Questions

Which is better, Qwen3 235B 2507 or LFM2.5-1.2B-Instruct?

Qwen3 235B 2507 is ahead overall, 37 to 30. The biggest single separator in this matchup is LongBench v2, where the scores are 52 and 34.

Which is better for knowledge tasks, Qwen3 235B 2507 or LFM2.5-1.2B-Instruct?

Qwen3 235B 2507 has the edge for knowledge tasks in this comparison, averaging 31.9 versus 26. Inside this category, MMLU is the benchmark that creates the most daylight between them.

Which is better for coding, Qwen3 235B 2507 or LFM2.5-1.2B-Instruct?

Qwen3 235B 2507 has the edge for coding in this comparison, averaging 14.6 versus 7.2. Inside this category, HumanEval is the benchmark that creates the most daylight between them.

Which is better for math, Qwen3 235B 2507 or LFM2.5-1.2B-Instruct?

Qwen3 235B 2507 has the edge for math in this comparison, averaging 46.6 versus 37. Inside this category, AIME 2023 is the benchmark that creates the most daylight between them.

Which is better for reasoning, Qwen3 235B 2507 or LFM2.5-1.2B-Instruct?

Qwen3 235B 2507 has the edge for reasoning in this comparison, averaging 45.6 versus 32.1. Inside this category, LongBench v2 is the benchmark that creates the most daylight between them.

Which is better for agentic tasks, Qwen3 235B 2507 or LFM2.5-1.2B-Instruct?

Qwen3 235B 2507 has the edge for agentic tasks in this comparison, averaging 33.7 versus 25.7. Inside this category, Terminal-Bench 2.0 is the benchmark that creates the most daylight between them.

Which is better for multimodal and grounded tasks, Qwen3 235B 2507 or LFM2.5-1.2B-Instruct?

Qwen3 235B 2507 has the edge for multimodal and grounded tasks in this comparison, averaging 41.6 versus 32.4. Inside this category, MMMU-Pro is the benchmark that creates the most daylight between them.

Which is better for instruction following, Qwen3 235B 2507 or LFM2.5-1.2B-Instruct?

LFM2.5-1.2B-Instruct has the edge for instruction following in this comparison, averaging 80 versus 69. Inside this category, IFEval is the benchmark that creates the most daylight between them.

Which is better for multilingual tasks, Qwen3 235B 2507 or LFM2.5-1.2B-Instruct?

LFM2.5-1.2B-Instruct has the edge for multilingual tasks in this comparison, averaging 60.7 versus 60.4. Inside this category, MGSM is the benchmark that creates the most daylight between them.

Last updated: March 12, 2026

Weekly LLM Benchmark Digest

Get notified when new models drop, benchmark scores change, or the leaderboard shifts. One email per week.

Free. No spam. Unsubscribe anytime. We only store derived location metadata for consent routing.