July 10, 2026
Bots, boxes, and betrayal
An Update on the scraper situation
Web owners say AI data thieves are out of control — and the comments are furious
TLDR: LWN says websites are being overwhelmed by data-hungry bot traffic, often routed through ordinary home devices like phones and media boxes. Commenters are split between wanting stronger defenses, building better public archives, and fighting back with "poison" data — while others fear the backlash could make the web less open for everyone.
The big headline from LWN is simple: the bot problem didn’t go away — it got worse. Websites are still being slammed by huge waves of fake visitors gathering material for artificial intelligence systems, and the really creepy twist is where that traffic seems to come from: ordinary home internet connections, phones, and even streaming boxes. In plain English, your living-room gadget may be helping hammer websites without you ever knowing. That detail sent commenters straight into outrage mode, with one basically saying this is just the usual modern-tech deal: "consent" hidden in the fine print, while regulators somehow never show up to the party.
But the comments didn’t stop at anger — they turned into a full-on open web civil war. One camp wants a better public archive, like Common Crawl, so AI companies have less excuse to smash random sites. Another warned that too much anti-scraping panic could backfire and hand even more power to gatekeepers like Cloudflare. In other words: are we saving the web, or accidentally locking it down?
Then came the chaos goblin energy. One commenter bragged about a growing scene devoted to poisoning scrapers with junk data, saying the poison "gets better every day" — a line that feels one step away from cyberpunk performance art. Others wondered whether some of this mess is being caused by people’s shiny new AI assistants constantly fetching pages on demand. So yes, the bots are bad — but the comment section’s real plot twist is everyone arguing over whether the cure might be just as dangerous as the disease.
Key Points
- •LWN says AI-related website scraping has continued to grow since its 2025 coverage and is making the open web harder to maintain.
- •The article reports that scraper attacks can involve millions of unique IP addresses in a few hours, with each address making only a small number of requests.
- •According to the article, much of the traffic is routed through residential and mobile networks using residential-proxy systems controlled by central command-and-control infrastructure.
- •Google's takedown of the IPIDEA bot network earlier in 2026 coincided with a temporary reduction in scraper traffic seen by LWN.
- •The article identifies both criminal malware-based proxy networks and more overt commercial operators such as Bright Data as contributors to the problem.