Background
A short history of data scrapers, and why creators are only now fighting back
Web scraping is almost as old as the web itself. In the mid-1990s, the first search engine crawlers politely walked from link to link, indexing pages so humans could find them. That original bargain was simple and mostly fair: a crawler read your page, sent visitors your way, and — if you asked it to stop through a robots.txt file — it usually listened. For nearly three decades that gentleman's agreement held. Bloggers, photographers, illustrators, and journalists published freely, understanding that their work would be read by both people and machines, but that the machines were largely there to help their audience discover them.
The rise of large language models and diffusion-based image generators broke that bargain. Beginning around 2020, industrial-scale scrapers began sweeping the open web not to index it, but to ingest it — pulling billions of images, essays, poems, forum posts, artist portfolios, and photo sets into training datasets used to build commercial AI products. Unlike a search crawler, a training crawler does not send visitors back to the source. It absorbs the work, learns from its style and substance, and enables downstream tools that can reproduce that style on demand, often without credit, license, or compensation to the original creator.
For most independent creators, the first sign that something had changed was personal. A novelist discovered their prose inside a chatbot's output. An illustrator watched a generator produce images that mimicked their signature palette. A photographer found their compositions echoed in AI-generated stock. The legal system is still catching up — class actions are pending in multiple jurisdictions, and licensing standards are being debated at every level from individual platforms to national copyright offices. In the meantime, a growing ecosystem of client-side, creator-first defenses has emerged. CloakMyWork belongs to that ecosystem: a small, honest, browser-only tool that lets any creator add friction to the ingestion pipeline in under a minute, without waiting for the courts or the platforms to solve the problem for them.