Does your model know when it doesn't know? A benchmark for the ESCALATE answer

Automated excerpt

Most leaderboards ask one question: did the model get it right? Every model gets two scores: its task score on the answerable items, and its false-confidence rate, meaning how often it answered anyway when the right reply was ESCALATE. Kaggle's hosted model suite: the frontier models.

Selected automatically from source text; not independently written or fact-checked. Read the original for full context.