AI article

Retrieval Is Not a Safety Boundary: Poisoned-Corpus and Unsupported-Question Evaluation of a RAG Pipeline

Community description: Abstract. I built a retrieval-augmented generation service with hybrid retrieval (dense + BM25), a...

Dev.to | Nov 3, 2026 | Tushar Kumar

Automated excerpt

I tested the two failure surfaces the standard evals never touch: a poisoned corpus (a planted document carrying a false claim, a steering instruction or a canary token, next to the real policy) and unsupported questions (questions the corpus cannot answer). All runs use the extractive mock generator. Eight unsupported questions (four near-misses against real policies, four far-misses) test refusal.

Selected automatically from source text; not independently written or fact-checked. Read the original for full context.

Read the original article

Read next

AI briefing: recent picks

More stories to explore