AI article
PipeWise: Turning r/Plumbing Into a Content Engine
Community description: Scrape a trade subreddit past its anti-bot wall, tag every post with a local LLM, cluster the questions people actually ask, and rank what to write next.
Dev.to | Aug 30, 2026 | C. Wheatley
Automated excerpt
PipeWise is the pipeline that does that structuring: scrape → enrich with a local model → store → cluster → rank → generate. The ingest half is cheap and local — Scrapling and a local Ollama model cost nothing per post — so it can run nightly under Windows Task Scheduler and accumulate. The Foundation and the Content Engine are built and tested — 78 test functions plus one gated live test verified against real Reddit.
Selected automatically from source text; not independently written or fact-checked. Read the original for full context.