Block fake Googlebots
-
Hello,
still one got through? π
81.31.248.0 - - [04/Jul/2023:17:52:22 +0200] "GET / HTTP/1.1" 200 - "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +https://www.google.com/bot.html)"
Greetings
-
Hi @wpapm
Thanks for raising issue.
It seems here 81.31.248.0 is IP address of the fake bot server try to fetch. and “Mozilla/5.0 (compatible; Googlebot/2.1; +https://www.google.com/bot.html)” is the User agent they used.
I will create internal ticket for this and get back to you asap.
Regards
Hi @wpapm
The issue regrding fake google bot not being blocked solved internally.
Please upload the zip as Add new plugin and replace it with existing AIOS plugin.
This fix is going to be in the next release.
Thanks! I was waiting for the release π
Hi @wpapm
It is released in 5.2.2 below is mentioned in change log.
FIX: Fake Google bots are now blocked if bot server IP address does not resolve to a hostname
Regards
a new IP that came through?
185.99.135.160 - - [08/Jan/2024:19:45:07 +0100] "GET /.git/config HTTP/1.1" 404 73750 "https://www.google.com/" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)" 185.99.135.160 - - [09/Jan/2024:07:54:50 +0100] "GET /.svn/entries HTTP/1.1" 404 73750 "https://www.google.com/" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
Greetings
Hi @wpapm
Ok, Thanks for rasing this issue.
I will create an internal ticket for this and get back to you asap.
Regards
Hi @wpapm
This issue was solved before and then rolled back it is saving in debulg log that gethostbyaddr failed.
Here it started to block real Google bots when gethostbyaddr is disabled by hosting company or some other reason.
Regards
another IP appeared:
185.99.135.160 [11/Jan/2024:18:14:56 +0100] This day 6 times "GET /wp-config.php~ ... and more" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
Greeting
-
This reply was modified 1 year, 2 months ago by
wpapm.
Hi @@hjogiupdraftplus,
Sorry, I only now saw that I had already reported the last IP. I guess I copied the wrong one π
But what about this one:
91.92.241.0 - - [11/Jan/2024:17:46:51 +0100] "GET /.wp-config.swn HTTP/1.1" 404 73750 "https://www.google.com/" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
Greetings
Hi @wpapm,
We are already working on enhancement for the fake google bot, IP ranges checked for Real google bot and rest considered the fake google bot.
https://developers.google.com/static/search/apis/ipranges/googlebot.json
Hi @@hjogiupdraftplus,
91.219.214.10 - - [05/Feb/2024:01:06:20 +0100] "GET /.wp-config.php.old HTTP/1.1" 404 73752 "https://www.google.com/" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
Greetings
Hi @wpapm
AIOS 5.3.0 has enhanced block fake Google bot features.
Let me know if you see any issues in the future.
Regards
-
This reply was modified 1 year, 2 months ago by
- The topic ‘Block fake Googlebots’ is closed to new replies.