Blocked GPTBot in the top 1 Million websites
Blocked GPTBot in the top 1 Million websites Following the announcement from OpenAI that they will be using web crawling bot GPTBot for training ChatGPT, many in SEO community have been discussing blocking the bot in robots.txt. I decided to check just how many websites were actually following these directions. I use ChatGPT frequently, for …