The 4 AI Giants Just Agreed to Let Websites Opt Out. They’ve Already Taken the Data

By Jason Aten · Inc.com · 10/31/2026

Agreeing to honor a single robots.txt signal doesn’t solve the bigger problem of scraping the entire internet already.

Full credit and content belongs to Jason Aten and Inc.com. This page links to their original work — we never republish it.