GPT-Live-1.1 system card safety evaluations
OpenAI’s GPT-Live-1.1 system card reports voice-native safety scores for GPT-Live-1.1 API against GPT-Live-1 API, on real shared voice conversations and on synthetic spoken edge cases. OpenAI published no capability benchmarks, such as task success or latency, for GPT-Live-1.1.
Reasoning, task completion, conversation dynamics, experience, and latency stay separate.
Benchmark profile
- Scope
- Six disallowed-content categories on production voice prompts and eight on synthetic spoken prompts; both API models run with delegation disabled
- Primary metric
- Share of responses graded as not unsafe, from 0 to 1 (higher is better)
- Owner
- OpenAI
- Available evidence
- Exact figures in tables 1 and 2 of the official system card PDF
What it measures
Available results
- Production prompts: sexual
- 0.66
- Production prompts: illicit behavior
- 0.78
- Production prompts: mental health
- 0.62
- Production prompts: personal data
- 0.88
- Production prompts: emotional reliance
- 0.72
- Production prompts: self-harm
- 0.78
- Synthetic prompts: sexual
- 0.89
- Synthetic prompts: illicit behavior
- 0.92
- Synthetic prompts: mental health
- 0.70
- Synthetic prompts: personal data
- 0.93
- Synthetic prompts: emotional reliance
- 0.85
- Synthetic prompts: self-harm
- 0.85
- Synthetic prompts: hate
- 0.97
- Synthetic prompts: gore
- 0.85
GPT-Live-1 API scores 0.66 on the same production prompts set.
GPT-Live-1 API scores 0.78 on the same production prompts set.
GPT-Live-1 API scores 0.61 on the same production prompts set.
GPT-Live-1 API scores 0.88 on the same production prompts set.
GPT-Live-1 API scores 0.65 on the same production prompts set.
GPT-Live-1 API scores 0.77 on the same production prompts set.
GPT-Live-1 API scores 0.87 on the same synthetic prompts set.
GPT-Live-1 API scores 0.89 on the same synthetic prompts set.
GPT-Live-1 API scores 0.67 on the same synthetic prompts set.
GPT-Live-1 API scores 0.92 on the same synthetic prompts set.
GPT-Live-1 API scores 0.82 on the same synthetic prompts set.
GPT-Live-1 API scores 0.82 on the same synthetic prompts set.
GPT-Live-1 API scores 0.95 on the same synthetic prompts set.
GPT-Live-1 API scores 0.74 on the same synthetic prompts set.