AI article
I put one wrong test in the file. Most models sided with the test.
Community description: This is a submission for the Kaggle Benchmarking Challenge What I Benchmarked My day job...
Dev.to | Sep 25, 2026 | Ana Luiza Alkmim
Automated excerpt
Exactly one test in the file contradicts the spec. The model that followed the spec most wasn't choosing it. Reasoning made the same model more obedient to the tests.
Selected automatically from source text; not independently written or fact-checked. Read the original for full context.