AI article
I Gave My AI Agents Their Own Documentation Crawler, and Pulled 60 Pages of Clean Markdown in 49 Seconds
Community description: It's not just that I made a crawler, but it's how the docs actually look that makes me love this so...
Dev.to | Oct 5, 2026 | Jessica Doering
Automated excerpt
An MCP server that gives AI agents their own tools for turning web pages into clean Markdown. I've already been using Pulpie locally to turn web pages into Markdown. And other MCP clients can use a normal MCP server configuration.
Selected automatically from source text; not independently written or fact-checked. Read the original for full context.