Skip to main content
BenchLM
Data

Instruction Following Benchmark (IFBench)

Flint leads the IFBench leaderboard on BenchLM's October 2026 update with 89.2%, ahead of MAI-Thinking-1 (85%) and Qwen3.8 Max (82.8%), across 57 models.

Data verified

IFBench evaluates precise instruction-following generalization on 58 challenging, verifiable out-of-domain constraints. Unlike IFEval which tests familiar constraint types, IFBench specifically measures how well models follow novel instructions they haven't been optimized for, exposing overfitting to common instruction patterns.

Top models on IFBench — October 29, 2026

As of October 29, 2026, Flint leads the IFBench leaderboard with 89.2% , followed by MAI-Thinking-1 (85%) and Qwen3.8 Max (82.8%).

57 modelsInstruction Following70% of category scoreCurrentUpdated October 29, 2026

Leaderboard (57 models)

IFBench leaderboard
RankModel / configurationScoreParameters (B)Open / closed
1FlintRecursive
89.2%
Not reportedOpen
2MAI-Thinking-1Microsoft
85%
Not reportedClosed
3Qwen3.8 MaxAlibaba
82.8%
Not reportedOpen
4Inkling-SmallThinking Machines Lab
82.2%
Not reportedOpen
5Nemotron 3 UltraNVIDIA
81.7%
Not reportedOpen
6Sage-A1.5InternScience
81.6%
Not reportedOpen
7Qwen3.8-Omni-FlashAlibaba
81.5%
Not reportedClosed
8Grok 4.3xAI
81.3%
Not reportedClosed
9Qwen3.8-Flash-NextAlibaba
81.3%
Not reportedOpen
10Beam 1.0 501B-A23B FP8Reflection AI
80.7%
Not reportedOpen
11dots3-note PreviewDots Studio
80.4%
Not reportedOpen
12Solar Open 2Upstage
80%
Not reportedOpen
13InklingThinking Machines Lab
79.8%
Not reportedOpen
14Beam 1.0 501B-A23BReflection AI
79.6%
Not reportedOpen
15Qwen3.8-27BAlibaba
79.5%
Not reportedOpen
16Granite 4.2 8BIBM
79.3%
Not reportedOpen
17Beam 1.0 501B-A23B NVFP4Reflection AI
79.2%
Not reportedOpen
18Qwen3.7 MaxAlibaba
79.1%
Not reportedClosed
19Qwen3.7 PlusAlibaba
79.1%
Not reportedClosed
20Granite 4.2 30BIBM
77.2%
Not reportedOpen
21Muse Glimmer 30BMeta
77%
Not reportedOpen
22Mercury 2.5Inception
77%
Not reportedClosed
23Mercury 3Inception
76.8%
Not reportedClosed
24Qwen3.5 397BAlibaba
76.5%
Not reportedOpen
25Gemini 3.5 FlashGoogle
76.3%
Not reportedClosed
26A.X K2SK Telecom
75.9%
Not reportedOpen
27Qwen3.6 PlusAlibaba
75.8%
Not reportedClosed
28Spark-X2.6-4BSparkLLM
75.8%
Not reportedOpen
29LFM2.5-24B-A2BLiquidAI
74.7%
Not reportedOpen
30Ling 3.0 FlashInclusionAI
74.5%
Not reportedOpen
31Granite 4.2 3BIBM
74.3%
Not reportedOpen
32Nemotron 3 Nano Omni 30B A3BNVIDIA
74.2%
Not reportedOpen
33Ternary Bonsai 2 27BPrism ML
74%
Not reportedOpen
34Ling 3.0 Flash FP8InclusionAI
73.4%
Not reportedOpen
35LFM3-1.7BLiquidAI
73.0%
Not reportedOpen
36Nemotron 3.5 Lightning 30B A3B NVFP4NVIDIA
72.9%
Not reportedOpen
37K-EXAONE 2.0LG AI Research
72.6%
Not reportedOpen
38Nemotron 3.5 Super VL 120B A12B NVFP4NVIDIA
71.5%
Not reportedOpen
39Mercury 2Inception
71.3%
Not reportedClosed
40Nemotron 3.5 Super VL 120B A12BNVIDIA
70.9%
Not reportedOpen
41Agents-A1-4BInternScience
69.1%
Not reportedOpen
42MiniCPM5-2BOpenBMB
66.3%
Not reportedOpen
43Hy3 PreviewTencent
63.1%
Not reportedOpen
44LFM2.5-2.6BLiquidAI
59.2%
Not reportedOpen
45Claude Opus 4.5Anthropic
58%
Not reportedClosed
46Ling 2.6 FlashInclusionAI
57%
Not reportedOpen
47LFM2.5-8B-A1BLiquidAI
56.5%
Not reportedOpen
48OrcaCyber-Nano-1.0OrcaRouter
56.3%
Not reportedOpen
49Solar Pro 3Upstage
55.8%
Not reportedClosed
50ZAYA1-8BZyphra
52.6%
Not reportedOpen
51Trinity-Large-ThinkingArcee AI
52.3%
Not reportedOpen
52MiniCPM5-1BOpenBMB
46.7%
Not reportedOpen
53LFM2.5-230MLiquidAI
38.4%
Not reportedOpen
54Kanana-2 1.3B InstructKakao
34.7%
Not reportedOpen
55Kanana-2 3B InstructKakao
33.3%
Not reportedOpen
56LFM2.5-VL-3BLiquidAI
25.8%
Not reportedOpen
57LLaDA2.2-miniInclusionAI
24.9%
Not reportedOpen

AA-IFBench

BenchLM stores the Artificial Analysis IFBench result separately from the core IFBench lane because Artificial Analysis controls the evaluation configuration.

AA-IFBench; source configurations remain separate from the canonical benchmark table.
Source rankSource model or configurationScoreSource setupParameters (B)Open / closed
1MiniMax M3MiniMax82.9%Artificial AnalysisOriginal resultNot reportedOpen
2Nemotron 3 UltraNVIDIA81.4%Artificial AnalysisOriginal resultNot reportedOpen
3Grok 4.3xAI81.3%Artificial AnalysisOriginal resultNot reportedClosed
4Qwen3.7 MaxAlibaba80.5%Artificial AnalysisOriginal resultNot reportedClosed
5MiMo-V2.5-ProXiaomi79.9%Artificial AnalysisOriginal resultNot reportedClosed
6Qwen3.5 397BAlibaba78.8%Artificial AnalysisOriginal resultNot reportedOpen
7Qwen3.5 397B (Reasoning)Alibaba78.8%Artificial AnalysisOriginal resultNot reportedOpen
8Qwen3.7 PlusAlibaba78.0%Artificial AnalysisOriginal resultNot reportedClosed
9GPT-5.2-CodexOpenAI77.6%Artificial AnalysisOriginal resultNot reportedClosed
10Gemini 3.1 ProGoogle77.1%Artificial AnalysisOriginal resultNot reportedClosed
11Qwen 3.6 Max (preview)Alibaba76.6%Artificial AnalysisOriginal resultNot reportedClosed
12DeepSeek V4 Pro 0813DeepSeek76.5%Artificial AnalysisOriginal resultNot reportedOpen
13Gemini 3.5 FlashGoogle76.3%Artificial AnalysisOriginal resultNot reportedClosed
14GLM-5.1Z.AI76.3%Artificial AnalysisOriginal resultNot reportedOpen
15Kimi K2.6Moonshot AI76.0%Artificial AnalysisOriginal resultNot reportedOpen
16GPT-5.5OpenAI75.9%Artificial AnalysisOriginal resultNot reportedClosed
17Muse SparkMeta75.9%Artificial AnalysisOriginal resultNot reportedClosed
18GPT-5.4 nanoOpenAI75.9%Artificial AnalysisOriginal resultNot reportedClosed
19Qwen3.5-122B-A10BAlibaba75.7%Artificial AnalysisOriginal resultNot reportedOpen
20MiniMax M2.7MiniMax75.7%Artificial AnalysisOriginal resultNot reportedOpen
21Qwen3.5-27BAlibaba75.6%Artificial AnalysisOriginal resultNot reportedOpen
22Gemma 4 31BGoogle75.6%Artificial AnalysisOriginal resultNot reportedOpen
23GPT-5.3 CodexOpenAI75.4%Artificial AnalysisOriginal resultNot reportedClosed
24GPT-5.2OpenAI75.4%Artificial AnalysisOriginal resultNot reportedClosed
25GPT-5.3-Codex-SparkOpenAI75.4%Artificial AnalysisOriginal resultNot reportedClosed
26GPT-5 miniOpenAI75.4%Artificial AnalysisOriginal resultNot reportedClosed
27Qwen3.6 PlusAlibaba75.2%Artificial AnalysisOriginal resultNot reportedClosed
28GPT-5.4OpenAI73.9%Artificial AnalysisOriginal resultNot reportedClosed
29Command A+Cohere73.9%Artificial AnalysisOriginal resultNot reportedOpen
30Gemma 4 12BGoogle73.5%Artificial AnalysisOriginal resultNot reportedOpen
31GLM-5.2Z.AI73.3%Artificial AnalysisOriginal resultNot reportedOpen
32GPT-5.4 miniOpenAI73.3%Artificial AnalysisOriginal resultNot reportedClosed
33GLM-5-TurboZ.AI73.2%Artificial AnalysisOriginal resultNot reportedClosed
34GPT-5 (high)OpenAI73.1%Artificial AnalysisOriginal resultNot reportedClosed
35GPT-5.1OpenAI72.9%Artificial AnalysisOriginal resultNot reportedClosed
36GPT-5.6 SolOpenAI72.7%Artificial AnalysisOriginal resultNot reportedClosed
37Qwen3.5-35B-A3BAlibaba72.5%Artificial AnalysisOriginal resultNot reportedOpen
38Gemma 4 26B A4BGoogle72.4%Artificial AnalysisOriginal resultNot reportedOpen
39GLM-5Z.AI72.3%Artificial AnalysisOriginal resultNot reportedOpen
40MiniMax M2.5MiniMax71.6%Artificial AnalysisOriginal resultNot reportedClosed
41o3OpenAI71.4%Artificial AnalysisOriginal resultNot reportedClosed
42DeepSeek V4 Pro (High)DeepSeek71.3%Artificial AnalysisOriginal resultNot reportedOpen
43GPT-5.6 TerraOpenAI71.2%Artificial AnalysisOriginal resultNot reportedClosed
44Solar Pro 3Upstage71.2%Artificial AnalysisOriginal resultNot reportedClosed
45GPT-5 (medium)OpenAI70.6%Artificial AnalysisOriginal resultNot reportedClosed
46Gemini 3 ProGoogle70.4%Artificial AnalysisOriginal resultNot reportedClosed
47o1OpenAI70.3%Artificial AnalysisOriginal resultNot reportedClosed
48Kimi K2.5 (Reasoning)Moonshot AI70.2%Artificial AnalysisOriginal resultNot reportedClosed
49Kimi K2.5Moonshot AI70.2%Artificial AnalysisOriginal resultNot reportedOpen
50GPT-5.1-CodexOpenAI70.0%Artificial AnalysisOriginal resultNot reportedClosed
51GPT-5.1-Codex-MaxOpenAI70.0%Artificial AnalysisOriginal resultNot reportedClosed
52Mercury 2Inception69.8%Artificial AnalysisOriginal resultNot reportedClosed
53GPT-OSS 120BOpenAI69.0%Artificial AnalysisOriginal resultNot reportedOpen
54MiMo-V2-ProXiaomi68.8%Artificial AnalysisOriginal resultNot reportedClosed
55Mistral Medium 3.5 128BMistral68.8%Artificial AnalysisOriginal resultNot reportedOpen
56o4-miniOpenAI68.7%Artificial AnalysisOriginal resultNot reportedClosed
57GLM-4.7Z.AI67.9%Artificial AnalysisOriginal resultNot reportedOpen
58Qwen3.6-27BAlibaba67.6%Artificial AnalysisOriginal resultNot reportedOpen
59GPT-5 nanoOpenAI67.6%Artificial AnalysisOriginal resultNot reportedClosed
60Step 3.7 FlashStepFun67.3%Artificial AnalysisOriginal resultNot reportedOpen
61Step 3.5 FlashStepFun66.5%Artificial AnalysisOriginal resultNot reportedOpen
62GPT-OSS 20BOpenAI65.1%Artificial AnalysisOriginal resultNot reportedOpen
63K-ExaoneLG AI Research64.7%Artificial AnalysisOriginal resultNot reportedClosed
64Qwen3.6-35B-A3BAlibaba64.4%Artificial AnalysisOriginal resultNot reportedOpen
65Claude Fable 5Anthropic63.5%Artificial AnalysisOriginal resultNot reportedClosed
66Nemotron 3 Nano Omni 30B A3BNVIDIA63.2%Artificial AnalysisOriginal resultNot reportedOpen
67Kimi K2.7 CodeMoonshot AI63.1%Artificial AnalysisOriginal resultNot reportedOpen
68Claude Opus 4.8Anthropic62.2%Artificial AnalysisOriginal resultNot reportedClosed
69GLM-5V-TurboZ.AI61.1%Artificial AnalysisOriginal resultNot reportedClosed
70Nemotron 3.5 Bolt E4BNVIDIA61.1%Artificial AnalysisOriginal resultNot reportedOpen
71GLM-4.7-FlashZ.AI60.8%Artificial AnalysisOriginal resultNot reportedOpen
72Claude Opus 4.7 (Adaptive)Anthropic58.6%Artificial AnalysisOriginal resultNot reportedClosed
73Claude Opus 4.5 ThinkingAnthropic58.0%Artificial AnalysisOriginal resultNot reportedClosed
74North Mini CodeCohere57.6%Artificial AnalysisOriginal resultNot reportedOpen
75Ling 2.6 FlashInclusionAI57.4%Artificial AnalysisOriginal resultNot reportedOpen
76Trinity-Large-ThinkingArcee AI56.3%Artificial AnalysisOriginal resultNot reportedOpen
77Trinity-Large-PreviewArcee AI56.3%Artificial AnalysisOriginal resultNot reportedOpen
78LFM2.5-8B-A1BLiquidAI55.6%Artificial AnalysisOriginal resultNot reportedOpen
79Claude 4.1 Opus ThinkingAnthropic55.4%Artificial AnalysisOriginal resultNot reportedClosed
80Gemini 3 FlashGoogle55.1%Artificial AnalysisOriginal resultNot reportedClosed
81Claude 4 Opus ThinkingAnthropic53.7%Artificial AnalysisOriginal resultNot reportedClosed
82Grok 4xAI53.7%Artificial AnalysisOriginal resultNot reportedClosed
83MiMo-V2-OmniXiaomi53.5%Artificial AnalysisOriginal resultNot reportedClosed
84Claude Opus 4.6 (Adaptive)Anthropic53.1%Artificial AnalysisOriginal resultNot reportedClosed
85Grok 4.1 Fast (Reasoning)xAI52.7%Artificial AnalysisOriginal resultNot reportedClosed
86Qwen3.5-4BAlibaba52.0%Artificial AnalysisOriginal resultNot reportedOpen
87Grok 4 Fast (Reasoning)xAI50.5%Artificial AnalysisOriginal resultNot reportedClosed
88DeepSeek V3.2DeepSeek49.0%Artificial AnalysisOriginal resultNot reportedOpen
89Gemini 2.5 ProGoogle48.7%Artificial AnalysisOriginal resultNot reportedClosed
90Claude 3.7 Sonnet ThinkingAnthropic48.3%Artificial AnalysisOriginal resultNot reportedClosed
91Mistral Small 4Mistral48.2%Artificial AnalysisOriginal resultNot reportedOpen
92Llama 3.3 70BMeta47.1%Artificial AnalysisOriginal resultNot reportedOpen
93Ultravox v0.6 Llama 3.3 70BFixie AI47.1%Artificial AnalysisOriginal resultNot reportedOpen
94LFM2-24B-A2BLiquidAI45.9%Artificial AnalysisOriginal resultNot reportedClosed
95Claude 4 SonnetAnthropic45.4%Artificial AnalysisOriginal resultNot reportedClosed
96Claude Opus 4.6Anthropic44.6%Artificial AnalysisOriginal resultNot reportedClosed
97Gemma 4 E4BGoogle44.2%Artificial AnalysisOriginal resultNot reportedOpen
98Qwen3 MaxAlibaba44.1%Artificial AnalysisOriginal resultNot reportedClosed
99Claude 3.7 SonnetAnthropic44.0%Artificial AnalysisOriginal resultNot reportedClosed
100LFM2.5-1.2B-InstructLiquidAI43.8%Artificial AnalysisOriginal resultNot reportedClosed
101Claude Opus 4.7Anthropic43.6%Artificial AnalysisOriginal resultNot reportedClosed
102Qwen3-Omni-30B-A3B-ThinkingAlibaba43.4%Artificial AnalysisOriginal resultNot reportedOpen
103Claude 4 OpusAnthropic43.3%Artificial AnalysisOriginal resultNot reportedClosed
104Claude Opus 4.5Anthropic43.0%Artificial AnalysisOriginal resultNot reportedClosed
105GPT-4.1OpenAI43.0%Artificial AnalysisOriginal resultNot reportedClosed
106Llama 4 MaverickMeta43.0%Artificial AnalysisOriginal resultNot reportedOpen
107Claude 3.5 HaikuAnthropic42.8%Artificial AnalysisOriginal resultNot reportedClosed
108MiniMax M1 80kMiniMax41.8%Artificial AnalysisOriginal resultNot reportedClosed
109LFM2.5-1.2B-ThinkingLiquidAI41.8%Artificial AnalysisOriginal resultNot reportedClosed
110DeepSeek V3.1 (Reasoning)DeepSeek41.5%Artificial AnalysisOriginal resultNot reportedOpen
111Kimi K2Moonshot AI41.5%Artificial AnalysisOriginal resultNot reportedClosed
112Grok Code Fast 1xAI41.4%Artificial AnalysisOriginal resultNot reportedClosed
113Claude Sonnet 4.6Anthropic41.2%Artificial AnalysisOriginal resultNot reportedClosed
114DeepSeek V3 0324DeepSeek41.0%Artificial AnalysisOriginal resultNot reportedOpen
115Gemini 2.0 FlashGoogle40.2%Artificial AnalysisOriginal resultNot reportedClosed
116MiMo-V2-FlashXiaomi39.9%Artificial AnalysisOriginal resultNot reportedOpen
117DeepSeek-R1DeepSeek39.6%Artificial AnalysisOriginal resultNot reportedOpen
118Llama 4 ScoutMeta39.5%Artificial AnalysisOriginal resultNot reportedOpen
119Mistral Medium 3Mistral39.3%Artificial AnalysisOriginal resultNot reportedClosed
120Gemini 2.5 FlashGoogle39.0%Artificial AnalysisOriginal resultNot reportedClosed
121Llama 3.1 405BMeta39.0%Artificial AnalysisOriginal resultNot reportedOpen
122QwQ-32BAlibaba38.8%Artificial AnalysisOriginal resultNot reportedOpen
123GPT-4.1 miniOpenAI38.3%Artificial AnalysisOriginal resultNot reportedClosed
124Nemotron Ultra 253BNVIDIA38.2%Artificial AnalysisOriginal resultNot reportedOpen
125Nova ProAmazon38.1%Artificial AnalysisOriginal resultNot reportedClosed
126Gemma 4 E2BGoogle38.0%Artificial AnalysisOriginal resultNot reportedOpen
127DeepSeek V3.1DeepSeek37.8%Artificial AnalysisOriginal resultNot reportedOpen
128GLM-4.5-AirZ.AI37.6%Artificial AnalysisOriginal resultNot reportedClosed
129Nemotron 3 Nano 30BNVIDIA37.5%Artificial AnalysisOriginal resultNot reportedOpen
130GLM-4.6Z.AI36.7%Artificial AnalysisOriginal resultNot reportedOpen
131Grok 4.1 FastxAI36.5%Artificial AnalysisOriginal resultNot reportedClosed
132Mistral Large 3Mistral36.2%Artificial AnalysisOriginal resultNot reportedClosed
133Claude 3 HaikuAnthropic36.1%Artificial AnalysisOriginal resultNot reportedClosed
134DeepSeek V3DeepSeek34.8%Artificial AnalysisOriginal resultNot reportedOpen
135Devstral SmallMistral34.6%Artificial AnalysisOriginal resultNot reportedOpen
136Sarvam 105BSarvam34.4%Artificial AnalysisOriginal resultNot reportedOpen
137GPT-4oOpenAI34.3%Artificial AnalysisOriginal resultNot reportedClosed
138Solar Pro 2Upstage33.7%Artificial AnalysisOriginal resultNot reportedClosed
139Exaone 4.0 32BLG AI Research33.5%Artificial AnalysisOriginal resultNot reportedOpen
140LFM2.5-VL-1.6B-ExtractLiquidAI33.1%Artificial AnalysisOriginal resultNot reportedOpen
141Mistral Small 4 (Reasoning)Mistral32.8%Artificial AnalysisOriginal resultNot reportedOpen
142GPT-4.1 nanoOpenAI32.0%Artificial AnalysisOriginal resultNot reportedClosed
143Ministral 3 14B (Reasoning)Mistral32.0%Artificial AnalysisOriginal resultNot reportedOpen
144Ministral 3 14BMistral32.0%Artificial AnalysisOriginal resultNot reportedOpen
145Gemma 3 27BGoogle31.8%Artificial AnalysisOriginal resultNot reportedOpen
146Gemini 2.5 Flash-LiteGoogle31.5%Artificial AnalysisOriginal resultNot reportedClosed
147Mistral Large 2Mistral31.2%Artificial AnalysisOriginal resultNot reportedClosed
148Qwen3-Omni-30B-A3B-InstructAlibaba31.2%Artificial AnalysisOriginal resultNot reportedOpen
149GPT-4o miniOpenAI31.0%Artificial AnalysisOriginal resultNot reportedClosed
150Mistral Small 3.1Mistral29.9%Artificial AnalysisOriginal resultNot reportedOpen
151Ministral 3 8B (Reasoning)Mistral29.1%Artificial AnalysisOriginal resultNot reportedOpen
152Ministral 3 8BMistral29.1%Artificial AnalysisOriginal resultNot reportedOpen
153Llama 3.1 70BMeta29.0%Artificial AnalysisOriginal resultNot reportedOpen
154Ministral 3 3B (Reasoning)Mistral26.8%Artificial AnalysisOriginal resultNot reportedOpen
155Ministral 3 3BMistral26.8%Artificial AnalysisOriginal resultNot reportedOpen
156Sarvam 30BSarvam26.5%Artificial AnalysisOriginal resultNot reportedOpen
157Granite-4.0-H-1BIBM26.2%Artificial AnalysisOriginal resultNot reportedOpen
158Exaone 4.0 1.2BLG AI Research25.3%Artificial AnalysisOriginal resultNot reportedOpen
159Magistral MediumMistral25.1%Artificial AnalysisOriginal resultNot reportedClosed
160Magistral SmallMistral24.8%Artificial AnalysisOriginal resultNot reportedOpen
161Phi-4Microsoft23.5%Artificial AnalysisOriginal resultNot reportedOpen
162Phi-4-reasoningMicrosoft23.5%Artificial AnalysisOriginal resultNot reportedOpen
163DeepSeek R1 Distill Qwen 32BDeepSeek22.9%Artificial AnalysisOriginal resultNot reportedOpen
164Granite-4.0-H-350MIBM17.6%Artificial AnalysisOriginal resultNot reportedOpen
165Granite-4.0-350MIBM15.9%Artificial AnalysisOriginal resultNot reportedOpen

According to BenchLM.ai, Flint leads the IFBench benchmark with a score of 89.2%, followed by MAI-Thinking-1 (85%) and Qwen3.8 Max (82.8%). The scores show moderate spread, with meaningful differences between the top tier and mid-tier models.

57 models have been evaluated on IFBench. The benchmark falls in the Instruction Following category. The Instruction Following leaderboard ranks models by a weighted category score, and IFBench contributes 70% of it. BenchAlign v5.8 also uses it in the overall ranking.

About IFBench

Year

2025

Tasks

58

Freshness and provenance

Version

IFBench 2025

Refresh cadence

Quarterly

Staleness state

Current

Question availability

Public benchmark set

Current

BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.

Questions

What does IFBench measure?

IFBench evaluates precise instruction-following generalization on 58 challenging, verifiable out-of-domain constraints. Unlike IFEval which tests familiar constraint types, IFBench specifically measures how well models follow novel instructions they haven't been optimized for, exposing overfitting to common instruction patterns.

Which model scores highest on IFBench?

Flint by Recursive currently leads with a score of 89.2% on IFBench.

How many models are evaluated on IFBench?

57 AI models have published results on IFBench in the BenchLM catalog.

Last updated: October 29, 2026 · BenchLM version IFBench 2025

Know when it’s worth switching models

The model to choose, the cheaper alternative, and the release we would wait on.

Read a sample issue

Join 6,100+ subscribers.

One email each week. Unsubscribe anytime.