AI article
Perplexity accused of scraping websites that explicitly blocked AI scraping
Publisher description: Internet giant Cloudflare says it detected Perplexity crawling and scraping websites, even after customers had added technical blocks telling Perplexity not to scrape their pages.
TechCrunch | Aug 4, 2025 | Lorenzo Franceschi-Bicchierai
Automated excerpt
AI startup Perplexity is crawling and scraping content from websites that have explicitly indicated they don’t want to be scraped, according to internet infrastructure provider Cloudflare. On Monday, Cloudflare published research saying it observed the AI startup ignore blocks and hide its crawling and scraping activities. Cloudflare has recently taken a public stance against AI crawlers.
Selected automatically from source text; not independently written or fact-checked. Read the original for full context.