AI article
A threshold is not a measurement: what your dedup cut actually does at each artefact length
Community description: The null of a similarity check rises with artefact length (char-bigram Dice: 0.5389 at L=40 to 0.9096 at L=3000), the boundary moves as a power law for one family of statistics and not the other, and below a measured floor every pair passes. Reproduce it in one command.
Dev.to | Oct 15, 2026 | howcani howcani
Automated excerpt
A cut calibrated on short artefacts therefore over-flags long ones — and a cut calibrated on long ones cannot certify anything about short ones. Below a certification floor L* the null's own p95 is 0, so the matched threshold is 0, so every pair passes: the false-positive rate is 1. 0, not alpha. Every pair passes, including every unrelated pair.
Selected automatically from source text; not independently written or fact-checked. Read the original for full context.