But remember – OpenAI also launched a web crawler, GPTBot, in August. Side note: If you blocked ChatGPT and other AI companies over content theft concerns, you may want to reconsider that.
GPTBot is the Microsoft-backed company's web crawler, which scrapes publicly accessible data online to feed into efforts to improve ChatGPT's accuracy - which may include copyrighted material.