HACKER Q&A
📣 rsolva

Will we see a license explicitly excluding AIs from scraping content?


In addition, should we make an equivalent to robots.txt or include some AI-related rules into robots.txt?


  👤 buro9 Accepted Answer ✓
Interestingly Google have a big advantage here, almost everyone wants to be top-ranked on Google and will gladly allow Google to crawl and scrape even when they aggressively close the door on everyone else crawling and scraping.

Google won't separate these things out, you get ranked high in the search engine _and_ your content goes into the AI machine, or you get neither.


👤 verdverm
What is the rationale here? Why is robots.txt not sufficient? Most search engines are already using AI, what separation are you trying to carve out with this question?