Google bots 403 question

Resolved

(@mizmichele)

I know you have answered this a number of times but I need help. I have read this forum and the one on your site and would like you to look at this.

I get a ton of 403 errors that all have to do with the google bot and my site has declined in rankings so I am trying to figure it out if BPS is blocking.

Is it really blocking?
If so, what steps do I take?
If it’s not blocking can you walk me through whitelisting?

Here are a few examples,

>>>>>>>>>>> 403 GET or Other Request Error Logged - March 23, 2014 - 9:26 am <<<<<<<<<<<
REMOTE_ADDR: 66.249.65.81
Host Name: crawl-66-249-65-81.googlebot.com
SERVER_PROTOCOL: HTTP/1.1
HTTP_CLIENT_IP:
HTTP_FORWARDED:
HTTP_X_FORWARDED_FOR: 66.249.65.81
HTTP_X_CLUSTER_CLIENT_IP:
REQUEST_METHOD: GET
HTTP_REFERER:
REQUEST_URI: /gender-injustice-las-vegas-teachers-tanikka-queen-and-melvyn-sprowson/16352/?utm_source=twitterfeed&utm_medium=twitter&utm_campaign=Feed%3A+LasVegasWorldNews+(Las+Vegas+World+News)
QUERY_STRING:
HTTP_USER_AGENT: Mediapartners-Google

>>>>>>>>>>> 403 GET or Other Request Error Logged - March 22, 2014 - 10:25 pm <<<<<<<<<<<
REMOTE_ADDR: 66.249.76.151
Host Name: crawl-66-249-76-151.googlebot.com
SERVER_PROTOCOL: HTTP/1.1
HTTP_CLIENT_IP:
HTTP_FORWARDED:
HTTP_X_FORWARDED_FOR: 66.249.76.151
HTTP_X_CLUSTER_CLIENT_IP:
REQUEST_METHOD: GET
HTTP_REFERER:
REQUEST_URI: /4-year-old-missing-ohio-girl-found-in-las-vegas/16243/?utm_source=feedburner&utm_medium=feed&utm_campaign=Feed%3A+LasVegasWorldNews+(Las+Vegas+World+News)
QUERY_STRING:
HTTP_USER_AGENT: Mozilla/5.0 (iPhone; CPU iPhone OS 6_0 like Mac OS X) AppleWebKit/536.26 (KHTML, like Gecko) Version/6.0 Mobile/10A5376e Safari/8536.25 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

>>>>>>>>>>> 403 GET or Other Request Error Logged - March 22, 2014 - 6:35 pm <<<<<<<<<<<
REMOTE_ADDR: 66.249.76.178
Host Name: crawl-66-249-76-178.googlebot.com
SERVER_PROTOCOL: HTTP/1.1
HTTP_CLIENT_IP:
HTTP_FORWARDED:
HTTP_X_FORWARDED_FOR: 66.249.76.178
HTTP_X_CLUSTER_CLIENT_IP:
REQUEST_METHOD: GET
HTTP_REFERER:
REQUEST_URI: /former-teacher-amanda-brennan-receives-probation-inappropriate-relationship/16443/?utm_source=feedburner&utm_medium=feed&utm_campaign=Feed%3A+LasVegasWorldNews+(Las+Vegas+World+News)
QUERY_STRING:
HTTP_USER_AGENT: Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

Any help and easy explanations are appreciated. Thank-you

https://wordpress.org/plugins/bulletproof-security/

Viewing 4 replies - 1 through 4 (of 4 total)

Plugin Author AITpro
(@aitpro)

12 years ago

Nope, BPS does not decrease or negatively impact SERPS’s and does not block any good bots like the GoogleBot. If you use our Speed Boost Cache code you can actually positively impact your SERPS’s.

These errors have to do with feedburner URL’s/links using round bracket coding characters in URL’s or to you humans (since I am a Cyborg) that would be parentheses ( and ).

You have 2 options:
1. Do no use round bracket code characters in URL’s.
2. Allow/whitelist round brackets sitewide by doing the Custom Code steps in this link: http://forum.ait-pro.com/forums/topic/allowing-parentheses-in-query-strings/#post-10589

Plugin Author AITpro
(@aitpro)

12 years ago

Is this issue resolved? If so, please resolve this thread. If not, please post a status update.

Plugin Author AITpro
(@aitpro)

12 years ago

Assuming that this answered all questions. Thread has been resolved.

Thread Starter Miz.Michele
(@mizmichele)

12 years ago

I am not sure because I am still troubleshooting but thank you

Viewing 4 replies - 1 through 4 (of 4 total)

The topic ‘Google bots 403 question’ is closed to new replies.

Tags