Essential for all website owners

Allowing AI crawlers is highly unlikely to increase your search engine ranking or the number of visitors to your site. Most likely the opposite, as they consume your bandwidth and CPU resources, making your site slower and less responsive for genuine visitors and search engine crawlers (sometimes causing 500 or 503 errors). We found OpenAI (GPTBot) was crippling our site making repeated requests every second or so, navigating a calendar widget (from Events Manager plugin) some 800 years into the future.

I started to implement the robots_txt filter to block some AI crawlers, then had a look to see if there was already a plugin to achieve this…

And found this, which does the job perfectly. It blocks 3 times as many AI crawlers than I knew about, can be confirgured to allow individual crawlers, and includes a description for each one to help you decide.