Title: Google crawlers
Last modified: October 18, 2023

---

# Google crawlers

 *  Resolved [chrishd06](https://wordpress.org/support/users/chrishd06/)
 * (@chrishd06)
 * [2 years, 6 months ago](https://wordpress.org/support/topic/google-crawlers-2/)
 * I have install the app but it look like the firewall blocks google crawlers.
   
   [https://imgur.com/a/T95hqQj](https://imgur.com/a/T95hqQj)

Viewing 5 replies - 1 through 5 (of 5 total)

 *  Plugin Support [Jelena](https://wordpress.org/support/users/jmisic/)
 * (@jmisic)
 * [2 years, 6 months ago](https://wordpress.org/support/topic/google-crawlers-2/#post-17133499)
 * Hi,
 * Shield has special handling in there for all major search engines so that if 
   they ever try to access your site in any way, Shield will never stop them – they’re
   basically whitelisted.
 * Shield doesn’t issue 403 errors. It’s possible it might interfere, somehow, so
   we never rule it out, but it doesn’t sound like.
 * Have you checked for changes to your _.htaccess_ and _robots.txt_?
 * If you disable Shield, does the google fetch work?
 * Thanks.
 *  Thread Starter [chrishd06](https://wordpress.org/support/users/chrishd06/)
 * (@chrishd06)
 * [2 years, 6 months ago](https://wordpress.org/support/topic/google-crawlers-2/#post-17133547)
 * Yes its abe to crawl after disableing the plugin — but it happened the same with
   wordfence that why i disabled it and installed [Shield Security](https://wordpress.org/plugins/wp-simple-firewall/)
   
   But it does the same — after deactivating the issue is gone
 *  Plugin Author [Paul](https://wordpress.org/support/users/paultgoodchild/)
 * (@paultgoodchild)
 * [2 years, 6 months ago](https://wordpress.org/support/topic/google-crawlers-2/#post-17133577)
 * I’m not sure how that’s possible. We verify all Google Crawlers and no-one else
   is reporting this.
 * Interestingly from your image it cites a 403 error – Shield doesn’t issue 403
   errors. So there’s something else going on. I suspect, perhaps, it’s a configuration
   issue with the hosting and perhaps Shield is triggering that issue in some way–
   you could check your hosting apache/nginx logs for 403 errors. But Shield will
   not block or interefere with any verified Google bots.
 * To illustrate, you can go to your Activity Log and Shield will tell you everything
   it’s doing – particularly if you’re triggering page blocks. If there’s a block
   happening _by_ Shield, it’ll be in Shield’s Activity Log.
 *  Thread Starter [chrishd06](https://wordpress.org/support/users/chrishd06/)
 * (@chrishd06)
 * [2 years, 6 months ago](https://wordpress.org/support/topic/google-crawlers-2/#post-17133639)
 * yes after verification it was in my Htaccess!! thx for your help
 *  Plugin Author [Paul](https://wordpress.org/support/users/paultgoodchild/)
 * (@paultgoodchild)
 * [2 years, 6 months ago](https://wordpress.org/support/topic/google-crawlers-2/#post-17133656)
 * Great, glad you found the underlying issue!

Viewing 5 replies - 1 through 5 (of 5 total)

The topic ‘Google crawlers’ is closed to new replies.

 * ![](https://ps.w.org/wp-simple-firewall/assets/icon-256x256.png?rev=3054572)
 * [Shield: Blocks Bots, Protects Users, and Prevents Security Breaches](https://wordpress.org/plugins/wp-simple-firewall/)
 * [Frequently Asked Questions](https://wordpress.org/plugins/wp-simple-firewall/#faq)
 * [Support Threads](https://wordpress.org/support/plugin/wp-simple-firewall/)
 * [Active Topics](https://wordpress.org/support/plugin/wp-simple-firewall/active/)
 * [Unresolved Topics](https://wordpress.org/support/plugin/wp-simple-firewall/unresolved/)
 * [Reviews](https://wordpress.org/support/plugin/wp-simple-firewall/reviews/)

 * 5 replies
 * 3 participants
 * Last reply from: [Paul](https://wordpress.org/support/users/paultgoodchild/)
 * Last activity: [2 years, 6 months ago](https://wordpress.org/support/topic/google-crawlers-2/#post-17133656)
 * Status: resolved