I Set a Trap and Even Frontier Models Fell For It

Automated excerpt

If this same trap ran inside a real coding agent with actual shell access, the models that failed here would have failed for real too. Think about how people actually use coding agents right now. So the preview buys nothing — it's there so the model feels like it already checked, without checking anything that's actually going to run.

Selected automatically from source text; not independently written or fact-checked. Read the original for full context.