Problem because of crawler

  • Resolved valarmurugan

    (@valarmurugan)


    10 years, 5 months ago

    i have noticed lot of IP were crawling my site frequently and my server load spike like any thing..

    later i have blocked lot of unwanted IP but now i have noticed My dedicated IP is crawling my Site frequently..

    Is it advisable to block that? if so what will be the consequences…

    https://wordpress.org/plugins/wordfence/

Viewing 1 replies (of 1 total)
  • Plugin Author WFMattR

    (@wfmattr)

    10 years, 5 months ago

    Normally, you will not want to block your server’s own IP. In this case, there may be something making all visits appear to come from the same IP — but if that is not happening, there might be a misconfiguration in the web server itself allowing visits to fake their IPs.

    Did you or your hosting company recently add any type of reverse proxy, such as Varnish, CloudFlare, or nginx? These will change the IP that Wordfence sees, since the connection to the web server will be coming from your own server, but there are settings that can be changed to fix it, if so.

    -Matt R

Viewing 1 replies (of 1 total)

The topic ‘Problem because of crawler’ is closed to new replies.