# Kimi K3.1 Pro vs Raw Qwen3 4B Instruct 2507 direct logits

> Side-by-side benchmark comparison for Kimi K3.1 Pro and Raw Qwen3 4B Instruct 2507 direct logits across agentic, coding, multimodal, knowledge, reasoning, multilingual, and math tasks.

- Canonical page: https://benchlm.ai/compare/kimi-3-1-pro-vs-raw-qwen3-4b-instruct-2507
- Last updated: October 23, 2026

- Shared sourced benchmarks: 0
- HTML indexing: indexable
- Ranking lane: BenchAlign v5.8

## Quick Verdict

No benchmark verdict yet: there is no shared sourced benchmark row for Kimi K3.1 Pro and Raw Qwen3 4B Instruct 2507 direct logits.

## Summary

- Kimi K3.1 Pro and Raw Qwen3 4B Instruct 2507 direct logits do not currently share a sourced benchmark row. The mirror therefore compares metadata, pricing, context windows, and each model's separately reported coverage without naming a benchmark winner.

## Model Snapshot

| Property | Kimi K3.1 Pro | Raw Qwen3 4B Instruct 2507 direct logits |
|----------|----------|----------|
| Creator | Moonshot AI | Alibaba |
| Type | Pending | Open Weight |
| Reasoning | Reasoning | Non-Reasoning |
| Context | 1.05M | null |
| Independent public score (not head-to-head) | null | null |
| Benchmarks Covered | 42 | 2 |
| Pricing (input/output) | $2.00 / $10.00 | Pricing unavailable / Pricing unavailable |

## Category Breakdown

### Agentic

- Winner: Insufficient shared evidence
- Kimi K3.1 Pro public-lane score: Coming soon
- Raw Qwen3 4B Instruct 2507 direct logits public-lane score: Coming soon

| Benchmark | Kimi K3.1 Pro | Raw Qwen3 4B Instruct 2507 direct logits | Winner |
|-----------|-----------|-----------|--------|
| Terminal-Bench 4.0 | 65.70% | Coming soon | Coming soon |
| Terminal-Bench-Science 0.1 | 38.1% | Coming soon | Coming soon |
| HLE w/ tools | 70.0% | Coming soon | Coming soon |
| BrowseComp | 92.1% | Coming soon | Coming soon |
| BioMysteryBench | 80.6% | Coming soon | Coming soon |
| Agents' Last Exam | 43.2% | Coming soon | Coming soon |
| Agents' Last Exam (CLI) | 44.2% | Coming soon | Coming soon |
| APEX-Agents | 67.2% | Coming soon | Coming soon |
| Frontier Finance | 58.6% | Coming soon | Coming soon |
| HANDBOOK.md | 44.6% | Coming soon | Coming soon |
| OSWorld 2.0 | 79.6% | Coming soon | Coming soon |
| Business Operation | 37.8% | Coming soon | Coming soon |
| Financial Modeling | 57.6% | Coming soon | Coming soon |
| Financial Research | 70.4% | Coming soon | Coming soon |
| Kimi Hallu Bench Hard (tools) | 8.3% | Coming soon | Coming soon |
| ExploitGym | 20.7% | Coming soon | Coming soon |

### Coding

- Winner: Insufficient shared evidence
- Kimi K3.1 Pro public-lane score: Coming soon
- Raw Qwen3 4B Instruct 2507 direct logits public-lane score: Coming soon

| Benchmark | Kimi K3.1 Pro | Raw Qwen3 4B Instruct 2507 direct logits | Winner |
|-----------|-----------|-----------|--------|
| DeepSWE | 75.5% | Coming soon | Coming soon |
| ProgramBench (binary) | 31.5% | Coming soon | Coming soon |
| Kimi Code Bench v2 | 77.1% | Coming soon | Coming soon |
| Kimi Code Bench 3.0 Long-horizon | 61.2% | Coming soon | Coming soon |
| sweMarathon | 51.7% | Coming soon | Coming soon |
| PostTrainBench v1.2 | 36.5% | Coming soon | Coming soon |

### Reasoning

- Winner: Insufficient shared evidence
- Kimi K3.1 Pro public-lane score: Coming soon
- Raw Qwen3 4B Instruct 2507 direct logits public-lane score: Coming soon

| Benchmark | Kimi K3.1 Pro | Raw Qwen3 4B Instruct 2507 direct logits | Winner |
|-----------|-----------|-----------|--------|
| JevBench 1.4 | Coming soon | 40.95 | Coming soon |
| JevBench 1.5 | Coming soon | 62.14 | Coming soon |

### Multimodal & Grounded

- Winner: Insufficient shared evidence
- Kimi K3.1 Pro public-lane score: 98 (#1/56)
- Raw Qwen3 4B Instruct 2507 direct logits public-lane score: Coming soon

| Benchmark | Kimi K3.1 Pro | Raw Qwen3 4B Instruct 2507 direct logits | Winner |
|-----------|-----------|-----------|--------|
| OfficeQA Pro | 67.4% | Coming soon | Coming soon |
| OfficeQA Pro v2 | 64.4% | Coming soon | Coming soon |
| BenchCAD Vision2Code (no tools) | 0.728 | Coming soon | Coming soon |
| BenchCAD Vision2Code (tools) | 0.927 | Coming soon | Coming soon |
| MMMU-Pro | 84.1% | Coming soon | Coming soon |
| MMMU-Pro w/ Python | 90% | Coming soon | Coming soon |
| CharXiv | 93.4% | Coming soon | Coming soon |
| CharXiv w/o tools | 89% | Coming soon | Coming soon |
| Chartography (tools) | 90.2% | Coming soon | Coming soon |
| BabyVision w/ Python | 95.4% | Coming soon | Coming soon |
| ZeroBench | 39.0% | Coming soon | Coming soon |
| ZeroBench w/ Python | 63.0% | Coming soon | Coming soon |
| GDP.pdf (Gemini judge) | 34.6% | Coming soon | Coming soon |
| GDP.pdf w/ Python (Gemini judge) | 85.7% | Coming soon | Coming soon |
| PerceptionBench | 68.3% | Coming soon | Coming soon |

### Knowledge

- Winner: Insufficient shared evidence
- Kimi K3.1 Pro public-lane score: Coming soon
- Raw Qwen3 4B Instruct 2507 direct logits public-lane score: Coming soon

| Benchmark | Kimi K3.1 Pro | Raw Qwen3 4B Instruct 2507 direct logits | Winner |
|-----------|-----------|-----------|--------|
| GPQA | 94.2% | Coming soon | Coming soon |
| GPQA-D | 94.2% | Coming soon | Coming soon |
| HLE | 70% | Coming soon | Coming soon |
| HLE w/o tools | 51.1% | Coming soon | Coming soon |
| Kimi Hallu Bench | 5.4% | Coming soon | Coming soon |

## FAQ

### Can I compare Kimi K3.1 Pro and Raw Qwen3 4B Instruct 2507 direct logits on BenchLM yet?

Not fully yet. BenchLM is tracking both models, but sourced benchmark coverage is still incomplete for a fair score-level comparison.

### Why does this page show "coming soon" values?

BenchLM only calls winners when public benchmark coverage is available on both sides of the comparison.

## Related Comparisons

- [Kimi K3.1 Pro vs Claude Opus 5.5](/compare/claude-opus-5-5-vs-kimi-3-1-pro)
- [Raw Qwen3 4B Instruct 2507 direct logits vs Claude Opus 5.5](/compare/claude-opus-5-5-vs-raw-qwen3-4b-instruct-2507)
- [Kimi K3.1 Pro vs GPT-6.1 Sol](/compare/gpt-6-1-sol-vs-kimi-3-1-pro)
- [Raw Qwen3 4B Instruct 2507 direct logits vs GPT-6.1 Sol](/compare/gpt-6-1-sol-vs-raw-qwen3-4b-instruct-2507)

## Explore More

- [Kimi K3.1 Pro profile](/models/kimi-3-1-pro)
- [Raw Qwen3 4B Instruct 2507 direct logits profile](/models/raw-qwen3-4b-instruct-2507)
- [Compare Pricing](/llm-pricing)
- [Alternative Finder](/tools/alternative-finder)
- [LLM Selector](/tools/llm-selector)
- [Overall Rankings](/best/overall)