Server Issues and WordPress

  • cybercelt1

    (@cybercelt1)


    14 years, 7 months ago

    Received alert from my hosting server company:
    ———————————————
    The behavior we are seeing is that the load on the server increases substantially when IPs request URLs under http://www.*mysite*.org/archives/, usually by web crawlers. This load then causes other customers’ sites to become nonresponsive. We have received multiple complaints about this daily since the site was moved to the new server.

    I checked the logs on the previous server and I found that similar issues had occurred there as well. This behavior therefore appears to be related to some portion of the site and not to moving to the new server.
    ———————————————

    Does anyone have any recommendations as to why this may be occuring or has anyone else experienced this kind of issue? We are running NetWorker 1.0 at the moment.

Viewing 6 replies - 1 through 6 (of 6 total)
  • Moderator Ipstenu (Mika Epstein)

    (@ipstenu)

    🏳️‍🌈 Advisor and Activist

    14 years, 7 months ago

    Are you running any plugins that have to do with archiving? I’m wondering why it’s THAT page that gets you nailed…

    You could always use a robots.txt to stop bots from scanning that folder.

    Thread Starter cybercelt1

    (@cybercelt1)

    14 years, 7 months ago

    We were running Global Translator which I believe can eat up some server time, but I’ve disabled it and there still seem to be problems. I’ll go look for other archive plugins. I don’t have a bot stopping text anywhere. I prolly could use something like that. Any recommendations?

    Moderator Ipstenu (Mika Epstein)

    (@ipstenu)

    🏳️‍🌈 Advisor and Activist

    14 years, 7 months ago

    http://perishablepress.com/wordpress-robots-rules/

    Thread Starter cybercelt1

    (@cybercelt1)

    14 years, 7 months ago

    I have added a robots.txt file in yet some of the crawlers are ignoring it and accessing the /archive/ files anyway, according to the hosting company.

    Is there an app or plugin that will correct this or simply block all crawlers? Or specify which crawlers I can allow?

    When I looked at the plugins, I didn’t see a specific one for my needs. I will look again, however. Any suggestions would be appreciated.

    Thread Starter cybercelt1

    (@cybercelt1)

    14 years, 7 months ago

    We have over four years of posts in the archives, several hundred in number. Would removing or somehow, compressing the archives or even archiving the archives(?) if that’s possible be a potential solution?

    Moderator Ipstenu (Mika Epstein)

    (@ipstenu)

    🏳️‍🌈 Advisor and Activist

    14 years, 7 months ago

    I would install “Bad Behavior” – It’s a plugin that stops bad-bots cold. That may help.

    And no, don’t remove the archives, it won’t help.

Viewing 6 replies - 1 through 6 (of 6 total)

The topic ‘Server Issues and WordPress’ is closed to new replies.

Tags