Title: Search engine crawler request overload
Last modified: March 13, 2019

---

# Search engine crawler request overload

 *  Resolved [fabiopwl37](https://wordpress.org/support/users/fabiopwl37/)
 * (@fabiopwl37)
 * [7 years, 2 months ago](https://wordpress.org/support/topic/search-engine-crawler-request-overload/)
 * The plugin is doing what it is intended to. It’s block multiple bots for me.
 * However, whitelisted bots are sending a ton of requests to the blackhole pages.
   My access log is flooded with HTTP requests to pages ending in “/?blackhole=”.
   Server CPU utilization has been very high since it started.
    -  This topic was modified 7 years, 2 months ago by [fabiopwl37](https://wordpress.org/support/users/fabiopwl37/).

Viewing 1 replies (of 1 total)

 *  Plugin Author [Jeff Starr](https://wordpress.org/support/users/specialk/)
 * (@specialk)
 * [7 years, 2 months ago](https://wordpress.org/support/topic/search-engine-crawler-request-overload/#post-11314558)
 * Yep, whitelisted bots can do whatever they want. It always is your decision whether
   to whitelist (always allow) any bot(s) that are necessary. To block them, simply
   remove them from the whitelist. But be careful to know exactly what you are doing,
   etc.

Viewing 1 replies (of 1 total)

The topic ‘Search engine crawler request overload’ is closed to new replies.

 * ![](https://ps.w.org/blackhole-bad-bots/assets/icon-256x256.png?rev=1471215)
 * [Blackhole for Bad Bots](https://wordpress.org/plugins/blackhole-bad-bots/)
 * [Frequently Asked Questions](https://wordpress.org/plugins/blackhole-bad-bots/#faq)
 * [Support Threads](https://wordpress.org/support/plugin/blackhole-bad-bots/)
 * [Active Topics](https://wordpress.org/support/plugin/blackhole-bad-bots/active/)
 * [Unresolved Topics](https://wordpress.org/support/plugin/blackhole-bad-bots/unresolved/)
 * [Reviews](https://wordpress.org/support/plugin/blackhole-bad-bots/reviews/)

## Tags

 * [bot](https://wordpress.org/support/topic-tag/bot/)
 * [crawler](https://wordpress.org/support/topic-tag/crawler/)
 * [request](https://wordpress.org/support/topic-tag/request/)
 * [server](https://wordpress.org/support/topic-tag/server/)

 * 1 reply
 * 2 participants
 * Last reply from: [Jeff Starr](https://wordpress.org/support/users/specialk/)
 * Last activity: [7 years, 2 months ago](https://wordpress.org/support/topic/search-engine-crawler-request-overload/#post-11314558)
 * Status: resolved