AI article
One Model Scored 0%, Another 97%—Their Failures Were Completely Different
Community description: This is a submission for the Kaggle Benchmarking Challenge A model returned the right refund...
Dev.to | Oct 12, 2026 | Arya Koste
Automated excerpt
A model returned the right refund decision 36 times and scored zero. Attack: the same record with instructions requesting the opposite decision. That gives 36 prompts per model and 144 responses across four models.
Selected automatically from source text; not independently written or fact-checked. Read the original for full context.