Tech article
Common Crawl Data Stored on a Hugging Face Bucket
No preview is available. Read the original article for the full story.
Hacker News | Sep 16, 2026 | abidlabs
Automated excerpt
Having the data on the Hugging Face (HF) lets you use the tools available in the HF ecosystem, making large-scale crawl data easier to access. Storage Buckets provide S3-like object storage on the Hugging Face Hub. The index files are also available on the Common Crawl HF bucket.
Selected automatically from source text; not independently written or fact-checked. Read the original for full context.