Ninjafirewall blocks Google crawler too?

  • Resolved staezione

    (@staezione)


    8 years, 7 months ago

    Hi, each day i get this line in my log:

    ` MEDIUM 531 185.53.44.71 GET /index.php – Suspicious bots/scanners – [SERVER:HTTP_USER_AGENT = Mozilla/5.0 (compatible; XoviBot/2.0; +http://www.xovibot.net/)]

    Can somebody tell me what this is? I guess it’s a seo crawler and was wondering if Ninjafirewall stops Google from indexing the website?

    Thanks!

Viewing 2 replies - 1 through 2 (of 2 total)
  • Plugin Author nintechnet

    (@nintechnet)

    8 years, 7 months ago

    Hi,

    NinjaFirewall does not block search engines such Google, Bing, Yahoo! Slurp, Yandex etc.
    It can block some crawlers that look suspicious (for several reasons) but that does not mean they are dangerous criminals. Just suspicious. There is a discussion about this bot here.

    If you want to whitelits it, you can use the .htninja user script.

    Thread Starter staezione

    (@staezione)

    8 years, 7 months ago

    Thanks for the quick information!

Viewing 2 replies - 1 through 2 (of 2 total)

The topic ‘Ninjafirewall blocks Google crawler too?’ is closed to new replies.