Hacker Newsnew | past | comments | ask | show | jobs | submitlogin
A Change to Common Crawl Dataset Size Reporting (commoncrawl.org)
3 points by ccgreg 69 days ago | hide | past | favorite | 1 comment


Common Crawl is switching to reporting dataset sizes in nibbles. As an organisation dedicated to data preservation, we feel it would be remiss to allow this underrepresented unit to fall out of use. Our latest crawl now exceeds 689 tebibbles. Common Crawl Foundation




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: