# LFM2.5-24B-A2B vs Beam 1.0 501B-A23B NVFP4 > Side-by-side benchmark comparison for LFM2.5-24B-A2B and Beam 1.0 501B-A23B NVFP4 across agentic, coding, multimodal, knowledge, reasoning, multilingual, and math tasks. - Canonical page: https://benchlm.ai/compare/lfm2-5-24b-a2b-vs-reflection-beam-nvfp4 - Last updated: October 16, 2026 - Shared sourced benchmarks: 5 - HTML indexing: indexable - Ranking lane: BenchAlign v5.8 ## Quick Verdict Beam 1.0 501B-A23B NVFP4 leads by point estimate. Conditional score ranges do not establish rank confidence. Choose using the category evidence and your own workload tests. ## Summary - Beam 1.0 501B-A23B NVFP4 has the higher overall point estimate 70 to 38. Conditional score ranges do not establish rank confidence. - The clearest category separation is in instruction following, where the averages are 75.6 for LFM2.5-24B-A2B and 86.2 for Beam 1.0 501B-A23B NVFP4. - The biggest single benchmark swing is SWE-bench Verified in Coding, with scores of 51% and 80.7%. - Beam 1.0 501B-A23B NVFP4 is the cheaper option on output tokens, which matters if you expect large responses or heavy interactive use. - Beam 1.0 501B-A23B NVFP4 also has the larger context window at 1M. ## Model Snapshot | Property | LFM2.5-24B-A2B | Beam 1.0 501B-A23B NVFP4 | |----------|----------|----------| | Creator | LiquidAI | Reflection AI | | Type | Open Weight | Open Weight | | Reasoning | Reasoning | Reasoning | | Context | 131K | 1M | | Overall Score | 38 | null | | Benchmarks Covered | 13 | 19 | | Pricing (input/output) | $0.10 / $1.00 | Pricing unavailable / Pricing unavailable | ## Category Breakdown ### Agentic - Winner: Not comparable - LFM2.5-24B-A2B public-lane score: 31.1 (Estimated · #92/128) - Beam 1.0 501B-A23B NVFP4 public-lane score: Coming soon | Benchmark | LFM2.5-24B-A2B | Beam 1.0 501B-A23B NVFP4 | Winner | |-----------|-----------|-----------|--------| | AutomationBench | 27.7% | Coming soon | Coming soon | | BFCL v4 | 65.0% | Coming soon | Coming soon | | τ³-bench results | 8.0% | 35.4% | Beam 1.0 501B-A23B NVFP4 | | PinchBench | 83.2% | Coming soon | Coming soon | | WebArena-Verified | 26.8% | Coming soon | Coming soon | | HLE w/ tools | Coming soon | 51.1% | Coming soon | | Terminal-Bench 2.1 | Coming soon | 78.4% | Coming soon | | MCP Atlas | Coming soon | 80.5% | Coming soon | | BrowseComp | Coming soon | 75.6% | Coming soon | | DeepSearchQA | Coming soon | 81.1% | Coming soon | ### Coding - Winner: Not comparable - LFM2.5-24B-A2B public-lane score: Coming soon - Beam 1.0 501B-A23B NVFP4 public-lane score: Coming soon | Benchmark | LFM2.5-24B-A2B | Beam 1.0 501B-A23B NVFP4 | Winner | |-----------|-----------|-----------|--------| | SciCode | 32.7% | 46.9% | Beam 1.0 501B-A23B NVFP4 | | SWE-bench Verified | 51% | 80.7% | Beam 1.0 501B-A23B NVFP4 | | DeepSWE | Coming soon | 42.7% | Coming soon | | SWE-bench Pro | Coming soon | 65.6% | Coming soon | | Terminal-Bench 2.1 | Coming soon | 78.4% | Coming soon | | SWE-Atlas Codebase QnA | Coming soon | 31.4% | Coming soon | | SWE Multilingual | Coming soon | 77.5% | Coming soon | ### Reasoning - Winner: Not comparable - LFM2.5-24B-A2B public-lane score: Coming soon - Beam 1.0 501B-A23B NVFP4 public-lane score: 85.5 (Unranked · 3 rankable rows) | Benchmark | LFM2.5-24B-A2B | Beam 1.0 501B-A23B NVFP4 | Winner | |-----------|-----------|-----------|--------| | CritPt | Coming soon | 15.4% | Coming soon | | LongBench v2 | Coming soon | 67.2% | Coming soon | ### Knowledge - Winner: Not comparable - LFM2.5-24B-A2B public-lane score: 40.7 (Estimated · #116/184) - Beam 1.0 501B-A23B NVFP4 public-lane score: Coming soon | Benchmark | LFM2.5-24B-A2B | Beam 1.0 501B-A23B NVFP4 | Winner | |-----------|-----------|-----------|--------| | GPQA | 74.4% | Coming soon | Coming soon | | GPQA-D | 74.4% | 89.3% | Beam 1.0 501B-A23B NVFP4 | | HLE | 7.4% | Coming soon | Coming soon | | HLE w/o tools | Coming soon | 34.8% | Coming soon | ### Instruction Following - Winner: Beam 1.0 501B-A23B NVFP4 - LFM2.5-24B-A2B public-lane score: 75.6 (#64/148) - Beam 1.0 501B-A23B NVFP4 public-lane score: 86.2 (#44/148) | Benchmark | LFM2.5-24B-A2B | Beam 1.0 501B-A23B NVFP4 | Winner | |-----------|-----------|-----------|--------| | IFEval | 96.8% | Coming soon | Coming soon | | IFBench | 74.7% | 79.2% | Beam 1.0 501B-A23B NVFP4 | ### Mathematics - Winner: Not comparable - LFM2.5-24B-A2B public-lane score: Coming soon - Beam 1.0 501B-A23B NVFP4 public-lane score: 87.9 (Unranked · 1 rankable row) | Benchmark | LFM2.5-24B-A2B | Beam 1.0 501B-A23B NVFP4 | Winner | |-----------|-----------|-----------|--------| | MATH-500 | 96.0% | Coming soon | Coming soon | | AIME26 | Coming soon | 97.5% | Coming soon | ## FAQ ### Which is better overall, LFM2.5-24B-A2B or Beam 1.0 501B-A23B NVFP4? Beam 1.0 501B-A23B NVFP4 has the higher overall point estimate. Conditional score ranges do not establish rank confidence. ### Where is the biggest gap between LFM2.5-24B-A2B and Beam 1.0 501B-A23B NVFP4? The widest category gap is in instruction following, where the averages are 75.6 for LFM2.5-24B-A2B and 86.2 for Beam 1.0 501B-A23B NVFP4. ### How many benchmarks does LFM2.5-24B-A2B cover on BenchLM? LFM2.5-24B-A2B currently has 13 sourced benchmark scores on BenchLM. ### How many benchmarks does Beam 1.0 501B-A23B NVFP4 cover on BenchLM? Beam 1.0 501B-A23B NVFP4 currently has 19 sourced benchmark scores on BenchLM. ## Related Comparisons - [LFM2.5-24B-A2B vs Beam 1.0 501B-A23B](/compare/lfm2-5-24b-a2b-vs-reflection-beam) - [Beam 1.0 501B-A23B NVFP4 vs Beam 1.0 501B-A23B](/compare/reflection-beam-vs-reflection-beam-nvfp4) - [LFM2.5-24B-A2B vs Beam 1.0 501B-A23B FP8](/compare/lfm2-5-24b-a2b-vs-reflection-beam-fp8) - [Beam 1.0 501B-A23B NVFP4 vs Beam 1.0 501B-A23B FP8](/compare/reflection-beam-fp8-vs-reflection-beam-nvfp4) ## Explore More - [LFM2.5-24B-A2B profile](/models/lfm2-5-24b-a2b) - [Beam 1.0 501B-A23B NVFP4 profile](/models/reflection-beam-nvfp4) - [Compare Pricing](/llm-pricing) - [Alternative Finder](/tools/alternative-finder) - [LLM Selector](/tools/llm-selector) - [Overall Rankings](/best/overall)