Should you block GPTbot?

by Kevin Indig for kevin-indig.com 84% of sites are likely to block ChatGPT. 790 of the top 1,000 sites have a business model that’s not incentivized to give generative AI their data. 🗺️Context: An analysis of the top 1,000 sites on the web from Originality AI shows 12% already block Chat GPT’s crawler. (source) The number jumped from 9.3% on August 22nd to 12% on August 29th. Since then, I found more sites, like Amazon, blocking Chat GPT in their robots.txt. It’s unclear how Originality AI put the list of top 1,000 sites together, but the biggest ones are on…

Read More