A hacker developed an "infinite maze" to trap web-crawlers/scrapers from AI companies
basically, if the server code detects that a web crawler from an AI firm is trying to scrape the site ...
... the code begins spinning up an infinite, nesting warren of new sham pages, filled with random text
so the crawler gets stuck crawling and scraping endless and meaningless pages
fun @jasonkoebler piece at @404mediaco
https://www.404media.co/email/7a39d947-4a4a-42bc-bbcf-3379f112c999/?ref=daily-stories-newsletter
Steve:
frequent overthinker, compulsive fixer, digester-then-explainer, "why?" question relishing father, minor-irritant partner, excessive disassembler, original-form hacker, high-efficiency googler, borderline-competent car-fixer, expert-level car-breaker, faster-by-qwerty communicator, indiscriminate photo-taker, Leatherman owner.