Plugin Author
Paul
(@paultgoodchild)
Hi,
Glad to hear you’re liking it so far.
When you refer to bots that are “already there” – how exactly do you mean?
This is from my awstats program in cpanel:
I think some of these bots are not legitimate.
Is there a way of getting rid of them?
cheers
Ken Gray please respond to [ email deleted. Don’t do that again on this site please. ]
bingbot 52,459+172 1.44 GB 18 Oct 2021 – 04:15
Googlebot 17,189+431 316.73 MB 18 Oct 2021 – 04:14
oBot 12,716+68 278.39 MB 17 Oct 2021 – 23:35
Unknown robot identified by bot\* 5,373+1114 216.91 MB 18 Oct 2021 – 04:13
Java ( catchall ) 5,996 178.07 MB 18 Oct 2021 – 03:21
facebookexternalhit 5,393 150.78 MB 18 Oct 2021 – 04:06
nutch ( catchall ) 4,851+64 77.42 MB 18 Oct 2021 – 00:47
Mediapartners-Google 4,464 100.06 MB 18 Oct 2021 – 03:57
Unknown robot (identified by hit on robots.txt) 0+3054 577.69 KB 18 Oct 2021 – 04:12
empty user agent string 1,721+892 125.38 MB 18 Oct 2021 – 04:02
Applebot 2,005+17 59.74 MB 18 Oct 2021 – 03:52
Feedfetcher-Google 1,591 13.04 MB 18 Oct 2021 – 03:58
feed 1,308 20.99 MB 18 Oct 2021 – 03:53
crawl 1,248+39 16.86 MB 18 Oct 2021 – 03:49
GrapeshotCrawler 1,133+22 33.80 MB 18 Oct 2021 – 03:39
Googlebot-Image 1,048 12.94 MB 18 Oct 2021 – 04:01
fetcher 977 29.32 MB 18 Oct 2021 – 03:38
proximic 825+47 24.54 MB 18 Oct 2021 – 00:35
Baidu ( catchall ) 790 20.31 MB 17 Oct 2021 – 19:46
YandexBot 637+148 19.44 MB 18 Oct 2021 – 04:13
MojeekBot 420+323 12.24 MB 18 Oct 2021 – 03:02
Curl 515 69.87 MB 18 Oct 2021 – 02:43
link 429+25 5.82 MB 18 Oct 2021 – 04:07
Firefox version 10 and lower – various robots 377 26.99 MB 18 Oct 2021 – 00:00
Mail.RU Bot
Moderator
Jan Dembowski
(@jdembowski)
Forum Moderator and Brute Squad
@kengray20 Do not post email addresses in this forum again. I have removed yours. That is a step too far.
Plugin Author
Paul
(@paultgoodchild)
There’s nothing to stop these requests reaching your server, so your awstats will always show these sorts of things.
Shield can automatically detect legitimate bots, such as Google, and will always whitelist them. If you want to block fake bots that “pretend” to be Google or other official bots, you’ll need ShieldPRO.
We don’t offer support for ShieldPRO on these forums. If you would like to know more about it, grab the free trial: https://getshieldsecurity.com/free-trial/