Skip to main content

Model comparison

Inkling-Small vs Llama 4 Behemoth

Updated July 30, 2026. Public scores include evidence status and uncertainty. They are not guarantees for a specific workload.

Inkling-Small

Thinking Machines Lab

Evidence status unavailable

90% interval unavailable

Llama 4 Behemoth

Meta

Evidence status unavailable

90% interval unavailable

The public evidence has no benchmark result shared by both models, so it does not support a quality verdict. Use the documented cost, context, and runtime rows instead.

0 results are shared. Category rows based on different benchmark sets are marked directional and do not name a winner.

Which one for your work

Recommendations appear only when a shared evidence basis or an explicit operating constraint supports the call. Secondary and unsupported use cases stay disclosed below the initial list.

  • Long documents

    Prompts that approach the documented context limit

    Inkling-Small

    Inkling-Small has the larger documented context window.

    Confidence: documented

Show secondary and unsupported calls
  • Coding work

    Code generation, repair, and software-engineering tasks

    Not enough matched evidence

    No shared weighted benchmark basis supports a winner.

    Confidence: limited

  • Agentic work

    Tool use, computer use, and multi-step task completion

    Not enough matched evidence

    No shared weighted benchmark basis supports a winner.

    Confidence: limited

  • Chat turn cost

    1K fresh input + 500 output tokens

    Not enough matched evidence

    A complete comparable API-rate estimate is not available for both models.

    Confidence: listed-rates

  • Cache-heavy agent loop cost

    200K cached + 20K fresh input + 10K output tokens

    Not enough matched evidence

    The page does not recommend a cost winner because at least one model cannot fit the stated workload in one request. Llama 4 Behemoth does not fit this workload in one request. Llama 4 Behemoth has no comparable published API token rate.

    Confidence: listed-rates

  • Repository review cost

    50K fresh input + 3K output tokens

    Not enough matched evidence

    The page does not recommend a cost winner because at least one model cannot fit the stated workload in one request. Llama 4 Behemoth does not fit this workload in one request. Llama 4 Behemoth has no comparable published API token rate.

    Confidence: listed-rates

What is actually comparable

Shared results can support a head-to-head reading. Results present for only one model describe coverage, not superiority.

Shared results
0
Inkling-Small only
20
Llama 4 Behemoth only
0
Like-for-like categories
0 / 8

Category results, on a stated basis

Each row states whether both averages use the same weighted benchmark set. Directional and not-comparable rows remain visible, but they never receive a winner in this template.

Agentic

Not comparable
Inkling-Small
70.1
Llama 4 Behemoth
Not measured
Weighted basis
2 vs 0 rows
Reading
Not comparable

Coding

Not comparable
Inkling-Small
62.4
Llama 4 Behemoth
Not measured
Weighted basis
3 vs 0 rows
Reading
Not comparable

Reasoning

Not comparable
Inkling-Small
40.1
Llama 4 Behemoth
Not measured
Weighted basis
1 vs 0 rows
Reading
Not comparable

Knowledge

Not comparable
Inkling-Small
53.4
Llama 4 Behemoth
Not measured
Weighted basis
2 vs 0 rows
Reading
Not comparable

Math

Not comparable
Inkling-Small
92.9
Llama 4 Behemoth
Not measured
Weighted basis
2 vs 0 rows
Reading
Not comparable

Multilingual

Not comparable
Inkling-Small
Not measured
Llama 4 Behemoth
Not measured
Weighted basis
0 vs 0 rows
Reading
Not comparable

Multimodal

Not comparable
Inkling-Small
76.6
Llama 4 Behemoth
Not measured
Weighted basis
2 vs 0 rows
Reading
Not comparable

Instruction following

Not comparable
Inkling-Small
82.2
Llama 4 Behemoth
Not measured
Weighted basis
1 vs 0 rows
Reading
Not comparable

Shape of the matched evidence

Only shared public evidence is shown. Sparse evidence stays a ruled list rather than being closed into a radar shape.

A shared-evidence shape is not available.

BenchLM does not draw a radar or infer missing axes when the matched evidence is too sparse.

What each workload costs

Three fixed token mixes turn per-token rates into comparable decisions. Each scenario states context fit and whether cached input had to fall back to the published list-input rate.

Chat turn

1K fresh input + 500 output tokens

Inkling-Small
$0.0013
Fits in one request
Llama 4 Behemoth
Self-hosted; infrastructure cost varies
Fits in one request

Llama 4 Behemoth has no comparable published API token rate.

Repository review

50K fresh input + 3K output tokens

Inkling-Small
$0.03332
Fits in one request
Llama 4 Behemoth
Self-hosted; infrastructure cost varies
Does not fit in one request

Llama 4 Behemoth does not fit this workload in one request. Llama 4 Behemoth has no comparable published API token rate.

Cache-heavy agent loop

200K cached + 20K fresh input + 10K output tokens

Inkling-Small
$0.0492
Fits in one request
Llama 4 Behemoth
Self-hosted; infrastructure cost varies
Does not fit in one request
Cached-input rate unavailable

Llama 4 Behemoth does not fit this workload in one request. Llama 4 Behemoth has no comparable published API token rate.

Specification differences

Sourced differences are shown directly. Missing facts stay explicit instead of being inferred from a model name or family.

Context window

Maximum documented context; output-token limits may be lower.

Inkling-Small

1M

Llama 4 Behemoth

32K

API model ID

Inkling-Small

Not sourced

Llama 4 Behemoth

Not sourced

Cached-input rate

A missing cached-input rate falls back to the listed input rate only in the stated workload estimate.

Inkling-Small

$0.116 per 1M cached input tokens

Llama 4 Behemoth

No comparable hosted API rate

Documented inputs

Inkling-Small

Not sourced

Llama 4 Behemoth

Not sourced

Documented outputs

Inkling-Small

Not sourced

Llama 4 Behemoth

Not sourced

Provider availability

Inkling-Small

Not sourced

Llama 4 Behemoth

Not sourced

Reasoning profile

Inkling-Small

Hybrid

Llama 4 Behemoth

Non-Reasoning

Weight access

Inkling-Small

Open Weight

Llama 4 Behemoth

Open Weight

License

Inkling-Small

Open Weight

Llama 4 Behemoth

Open Weight

Release date

Inkling-Small

2026-07-30

Llama 4 Behemoth

2026-02-28

If you already use one of these models
Deployment change
The models list different providers, so authentication, endpoint behavior, limits, and feature support may change.
Quality signal
The public evidence has no benchmark result shared by both models, so it does not support a quality verdict.
Workload cost
A complete comparable API-rate estimate is not available for both models.
Context tradeoff
Inkling-Small has the larger documented window (1M).

Run the same representative tasks against both endpoints before changing production traffic.

Benchmark evidence

The full public result ledger is available for audit without forcing a wide desktop table onto a phone.

Browse raw public benchmark evidence20 rows

Agentic

  • Terminal-Bench 2.0

    Inkling-Small64.7%
    Source
    Llama 4 Behemoth

    Not directly comparable

  • BrowseComp

    Inkling-Small77.4%
    Source
    Llama 4 Behemoth

    Not directly comparable

  • MCP Atlas

    Inkling-Small79.6%
    Source
    Llama 4 Behemoth

    Not directly comparable

  • Toolathlon-Verified

    Inkling-Small54.4%
    Source
    Llama 4 Behemoth

    Not directly comparable

Coding

  • SWE-bench Verified

    Inkling-Small80.2%
    Source
    Llama 4 Behemoth

    Not directly comparable

  • SWE-bench Pro

    Inkling-Small55.9%
    Source
    Llama 4 Behemoth

    Not directly comparable

  • Terminal-Bench 2.0

    Inkling-Small64.7%
    Source
    Llama 4 Behemoth

    Not directly comparable

  • SciCode

    Inkling-Small48.7%
    Source
    Llama 4 Behemoth

    Not directly comparable

Reasoning

  • ARC-AGI-2

    Inkling-Small40.1%
    Source
    Llama 4 Behemoth

    Not directly comparable

  • CritPt

    Inkling-Small8.3%
    Source
    Llama 4 Behemoth

    Not directly comparable

Knowledge

  • GPQA

    Inkling-Small89.5%
    Source
    Llama 4 Behemoth

    Not directly comparable

  • GPQA-D

    Inkling-Small89.5%
    Source
    Llama 4 Behemoth

    Not directly comparable

  • HLE

    Inkling-Small47.8%
    Source
    Llama 4 Behemoth

    Not directly comparable

  • HLE w/o tools

    Inkling-Small31.6%
    Source
    Llama 4 Behemoth

    Not directly comparable

Math

  • AIME26

    Inkling-Small95.5%
    Source
    Llama 4 Behemoth

    Not directly comparable

  • HMMT Feb 2026

    Inkling-Small90.2%
    Source
    Llama 4 Behemoth

    Not directly comparable

Multimodal

  • MMMU-Pro

    Inkling-Small74%
    Source
    Llama 4 Behemoth

    Not directly comparable

  • CharXiv

    Inkling-Small81.3%
    Source
    Llama 4 Behemoth

    Not directly comparable

  • CharXiv w/o tools

    Inkling-Small77.4%
    Source
    Llama 4 Behemoth

    Not directly comparable

Instruction following

  • IFBench

    Inkling-Small82.2%
    Source
    Llama 4 Behemoth

    Not directly comparable

Frequently asked questions

Which is better, Inkling-Small or Llama 4 Behemoth?

The public evidence has no benchmark result shared by both models, so it does not support a quality verdict. The page therefore keeps the decision tied to the specific documented workload.

Which is better for coding, Inkling-Small or Llama 4 Behemoth?

The published evidence does not provide a shared weighted coding basis for both models, so BenchLM does not name a coding winner.

Which is better for agentic tasks, Inkling-Small or Llama 4 Behemoth?

The published evidence does not provide a shared weighted agentic tasks basis for both models, so BenchLM does not name a agentic tasks winner.

Which costs less, Inkling-Small or Llama 4 Behemoth?

Both models do not have comparable published API token rates, so this page does not name a universal price winner.

Which has the larger context window, Inkling-Small or Llama 4 Behemoth?

Inkling-Small has the larger documented context window: 1M, compared with 32K.

Related comparisons

Last updated July 30, 2026

Watch Inkling-Small vs Llama 4 Behemoth

One weekly email when material rank, price, or benchmark evidence changes make this matchup worth revisiting.

Read a sample issue

Join 2,000+ readers.