AI article
246 of the top 1,000 sites answer /llms.txt with 200. Only 114 serve the file.
Community description: I checked llms.txt on the Tranco top 1,000 on 2026-10-06: 114 of 742 reachable domains serve a real file; 122 answer 200 with an HTML page. Format, size, dead links, and a check that doesn't lie.
Dev.to | Oct 6, 2026 | Mahiro Hirakawa
Automated excerpt
I checked the top 1,000 domains today. 246 answered 200. 114 of them actually served an llms. txt file. Not counted as "no file": 70 domains answered /llms. txt with 401 or 403. IFS=$'\t' read -r code ctype final < <(curl -s -L -o "$tmp" -A 'Mozilla/5. 0' \ if [ "$code" ! = 200 ]; then echo " -> no file ($code)" elif [[ "$ctype" == *html* || "$first" == \<* ]]; then echo " -> HTML page answering 200, not an llms. txt" elif [[ "${final%%\? *}" ! = */llms.
Selected automatically from source text; not independently written or fact-checked. Read the original for full context.