Title: Server Issues and WordPress
Last modified: August 20, 2016

---

# Server Issues and WordPress

 *  [cybercelt1](https://wordpress.org/support/users/cybercelt1/)
 * (@cybercelt1)
 * [14 years, 7 months ago](https://wordpress.org/support/topic/server-issues-and-wordpress/)
 * Received alert from my hosting server company:
    ——————————————— The behavior 
   we are seeing is that the load on the server increases substantially when IPs
   request URLs under [http://www.*mysite*.org/archives/](http://www.*mysite*.org/archives/),
   usually by web crawlers. This load then causes other customers’ sites to become
   nonresponsive. We have received multiple complaints about this daily since the
   site was moved to the new server.
 * I checked the logs on the previous server and I found that similar issues had
   occurred there as well. This behavior therefore appears to be related to some
   portion of the site and not to moving to the new server.
    ———————————————
 * Does anyone have any recommendations as to why this may be occuring or has anyone
   else experienced this kind of issue? We are running NetWorker 1.0 at the moment.

Viewing 6 replies - 1 through 6 (of 6 total)

 *  Moderator [Ipstenu (Mika Epstein)](https://wordpress.org/support/users/ipstenu/)
 * (@ipstenu)
 * 🏳️‍🌈 Advisor and Activist
 * [14 years, 7 months ago](https://wordpress.org/support/topic/server-issues-and-wordpress/#post-2377621)
 * Are you running any plugins that have to do with archiving? I’m wondering why
   it’s THAT page that gets you nailed…
 * You could always use a robots.txt to stop bots from scanning that folder.
 *  Thread Starter [cybercelt1](https://wordpress.org/support/users/cybercelt1/)
 * (@cybercelt1)
 * [14 years, 7 months ago](https://wordpress.org/support/topic/server-issues-and-wordpress/#post-2377627)
 * We were running Global Translator which I believe can eat up some server time,
   but I’ve disabled it and there still seem to be problems. I’ll go look for other
   archive plugins. I don’t have a bot stopping text anywhere. I prolly could use
   something like that. Any recommendations?
 *  Moderator [Ipstenu (Mika Epstein)](https://wordpress.org/support/users/ipstenu/)
 * (@ipstenu)
 * 🏳️‍🌈 Advisor and Activist
 * [14 years, 7 months ago](https://wordpress.org/support/topic/server-issues-and-wordpress/#post-2377630)
 * [http://perishablepress.com/wordpress-robots-rules/](http://perishablepress.com/wordpress-robots-rules/)
 *  Thread Starter [cybercelt1](https://wordpress.org/support/users/cybercelt1/)
 * (@cybercelt1)
 * [14 years, 7 months ago](https://wordpress.org/support/topic/server-issues-and-wordpress/#post-2377843)
 * I have added a robots.txt file in yet some of the crawlers are ignoring it and
   accessing the /archive/ files anyway, according to the hosting company.
 * Is there an app or plugin that will correct this or simply block all crawlers?
   Or specify which crawlers I can allow?
 * When I looked at the plugins, I didn’t see a specific one for my needs. I will
   look again, however. Any suggestions would be appreciated.
 *  Thread Starter [cybercelt1](https://wordpress.org/support/users/cybercelt1/)
 * (@cybercelt1)
 * [14 years, 7 months ago](https://wordpress.org/support/topic/server-issues-and-wordpress/#post-2377844)
 * We have over four years of posts in the archives, several hundred in number. 
   Would removing or somehow, compressing the archives or even archiving the archives(?)
   if that’s possible be a potential solution?
 *  Moderator [Ipstenu (Mika Epstein)](https://wordpress.org/support/users/ipstenu/)
 * (@ipstenu)
 * 🏳️‍🌈 Advisor and Activist
 * [14 years, 7 months ago](https://wordpress.org/support/topic/server-issues-and-wordpress/#post-2377846)
 * I would install “Bad Behavior” – It’s a plugin that stops bad-bots cold. That
   may help.
 * And no, don’t remove the archives, it won’t help.

Viewing 6 replies - 1 through 6 (of 6 total)

The topic ‘Server Issues and WordPress’ is closed to new replies.

## Tags

 * [server](https://wordpress.org/support/topic-tag/server/)

 * In: [Everything else WordPress](https://wordpress.org/support/forum/miscellaneous/)
 * 6 replies
 * 2 participants
 * Last reply from: [Ipstenu (Mika Epstein)](https://wordpress.org/support/users/ipstenu/)
 * Last activity: [14 years, 7 months ago](https://wordpress.org/support/topic/server-issues-and-wordpress/#post-2377846)
 * Status: not resolved

## Topics

### Topics with no replies

### Non-support topics

### Resolved topics

### Unresolved topics

### All topics