AI article

AI search can reach almost every site we audited. Most give it little worth quoting

Community description: Every month we publish totals from the websites people audit on SEO AI Audits, a free SEO audit tool...

Dev.to | Nov 7, 2026 | Kaustav Basak

Automated excerpt

Every month we publish totals from the websites people audit on SEO AI Audits, a free SEO audit tool our team builds. Each site counts once, and no site is named. 1 site in 106 blocked AI search tools in its robots.txt. 4% blocked AI training crawlers. Many AI crawlers fetch the raw HTML and never run scripts, so that text may never be seen.

Selected automatically from source text; not independently written or fact-checked. Read the original for full context.

Read the original article

Read next

AI briefing: recent picks

More stories to explore