The bug your test suite can't have: a test you never wrote

Automated excerpt

Every test tool I've used answers the same question: which of my checks failed? Now delete the "reply in English" line from the prompt and rerun the same suite. And every assertion still passes, because nothing in the suite ever looked at the language: dropped line: "- Always reply in English. " fix: add checks. llm_judge("the reply still follows: - Always reply in English. ") The suite wasn't green because the system was fine.

Selected automatically from source text; not independently written or fact-checked. Read the original for full context.