# When2Call Multi-Turn (NVIDIA) (When2Call Multi-Turn)

> NVIDIA multi-turn version of When2Call that tests whether a model calls a tool, asks a follow-up question, or abstains.

Canonical page: https://benchlm.ai/benchmarks/when2callmultiturn

- Category: [Agentic](/agentic)
- Last updated: October 29, 2026

## About When2Call Multi-Turn

- Year: 2026
- Tasks: Multi-turn tool-use decisions (not yet published)
- Format: Overall accuracy
- Difficulty: When to call, clarify or abstain
- Paper: [NVIDIA Nemotron 3.5 Bolt E4B 4GB](https://research.nvidia.com/labs/nemotron/NVIDIA-Nemotron-3.5-Bolt-E4B-4GB/)

NVIDIA reports it for Nemotron 3.5 Bolt E4B (October 23, 2026), run in its NeMo Gym harness, as overall accuracy in reasoning mode. NVIDIA says this multi-turn version will be released later, so its tasks and scoring are not public yet.

When2Call Multi-Turn is currently displayed on BenchLM for reference, but it is excluded from the weighted scoring formula.

## Leaderboard (2 models)

| Rank | Model | Creator | Score |
|------|-------|---------|-------|
| 1 | [Nemotron 3.5 Bolt E4B BF16](/models/nemotron-3-5-bolt-e4b-bf16) | NVIDIA | 63.36% |
| 2 | [Nemotron 3.5 Bolt E4B](/models/nemotron-3-5-bolt-e4b) | NVIDIA | 60.50% |

## FAQ

### What does When2Call Multi-Turn measure?

NVIDIA multi-turn version of When2Call that tests whether a model calls a tool, asks a follow-up question, or abstains.

### Which model scores highest on When2Call Multi-Turn?

Nemotron 3.5 Bolt E4B BF16 by NVIDIA currently leads with a score of 63.36% on When2Call Multi-Turn.

### How many models are evaluated on When2Call Multi-Turn?

2 AI models have published results on When2Call Multi-Turn in the BenchLM catalog.

### Does When2Call Multi-Turn affect BenchLM's overall score?

Not directly. When2Call Multi-Turn is still displayed on BenchLM for reference, but it is excluded from the weighted scoring formula.

## Compare Top Models on When2Call Multi-Turn

- [Nemotron 3.5 Bolt E4B BF16 vs Nemotron 3.5 Bolt E4B](/compare/nemotron-3-5-bolt-e4b-vs-nemotron-3-5-bolt-e4b-bf16)