AI article
Questions for a chatbot
Community description: I audited 68 chatbot answers with an auditor that returns what was missing instead of a grade: it passed 1, and the 205 gaps became work (22 tickets, 11 done). The follow-up measurement is still pending.
Dev.to | Oct 1, 2026 | Lisandro Reinoso
Automated excerpt
The chatbot answers questions about pasture growth rates with a chart and a text that explains it. To find out whether it answers well, I built a golden set: 68 questions, none of them from real users. Before measuring again I wrote hypotheses with a threshold: rejected answers, from 35 down to 20 or fewer; the reference date, from 24 down to 5 or fewer.
Selected automatically from source text; not independently written or fact-checked. Read the original for full context.