Cloudflare crawl endpoint

Automated excerpt

You can now crawl an entire website with a single API call using Browser Rendering's new /crawl endpoint, available in open beta. Note: the /crawl endpoint cannot bypass Cloudflare bot detection or captchas, and self-identifies as a bot. To get started, refer to the crawl endpoint documentation.

Selected automatically from source text; not independently written or fact-checked. Read the original for full context.