You can basically SELECT * the internet by querying the public Common Crawl dataset on S3 with DuckDB. It's a great way to explore how the AI-pilled web (Vercel, Lovable, Replit, Bolt, Cloudflare, GitHub) compare to the traditional Wordpress-Blogspot hegemony.
You can basically SELECT * the internet by querying the public Common Crawl dataset on S3 with DuckDB. It's a great way to explore how the AI-pilled web (Vercel, Lovable, Replit, Bolt, Cloudflare, GitHub) compare to the traditional Wordpress-Blogspot hegemony.