Stop AI Bots
-
Hi there!
These days there are so many AI Bots out there. Only a handful of them are really good for your site and for ranking. Most of the bots only scan your site for there purpose and steels your info. Like the Meta bots, they are scanning my site 20 times a day and they ignore robotext that blocks them from scanning your site. This don’t work:
User-agent: meta-externalagent
Disallow: /Can’t you create a function where a person can block or allow some bots.
You must be logged in to reply to this topic.