AI article
A Grammar Stopped My Model Inventing FAR Clauses. It Also Made It Refuse the Real Ones
Community description: A registry grammar cut fabricated FAR clause numbers from 57/60 to 0. Add an abstain option and a 1.5B model refuses every prompt that names a clause.
Dev.to | Oct 9, 2026 | Raihan
Automated excerpt
With an abstain option added, a 1. 5B model answered "none" to every question that named a clause number, real or not. The obvious fix: compile the registry (1,128 raw entries, 1,056 distinct canonical clause IDs) into a decoding grammar so the model cannot emit a nonexistent number. With the grammar the model said NONE on all 30 prompts that name a clause number: the 15 real ones (wrongly) and the 15 absent ones (rightly).
Selected automatically from source text; not independently written or fact-checked. Read the original for full context.