Robots…
-
OK… ever since i upgraded to 2.0, i have been getting nonstop hits from bots…and its not that they are just hitting my site, they are creating more false hits by trying to go to pages and files that aren’t even and never have been on my site…
whats going on? i used to get random hits from them from time to time, but its going non stop now…
-
i had to deactivate it cause it wouldn’t let me get to my site…
and it was still hitting my site with that plugin…
wow… in only two minutes i got 47 hits from…
Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1)
i have no idea who that is or who to contact about that one because no info is given…
there should be some sort of law for bots…grrrr
So, have you re-activated bad Behavior, or have you just given up on it? It should be stopping at least some of those bots, especially the one that accessed your site 47 times in two minutes.
the only reason i haven’t is because of the issue of it blocking me from accessing my own site… and yes, i did notice a slowdown on them… but i’m still lost as to why the supposedly “good” bots are just going to every page over and over and over again…and why they are trying to access things that aren’t even there… i’ve done some searches on the net and i can’t find a reason no where…
that won’t work for me cause of the issue with godaddy.com hosting…
i’m not going to switch hosting plans like it suggests, i’m getting a way too good of a deal for what i got…
those fuckin bots are getting annoying though….lol
i’m still tryin to find something official on the net about the issue…
I thought that the point of these robots were to just follow links that are on the pages for search engines and the like. Even the so called “good robots” are attempting to go to pages that don’t exist. Sometimes its to pages that just aren’t there, and sometimes they start with a link that does exist and go and add something to the end…
to clarify a lil more on my previous post, here is an example…
they will try to go to a post mydomain.com/post-title/ , which is a valid link to a post, but then some will add numbers or the word feed to the end, mydomain.com/post-title/106/ or mydomain.com/post-title/feed/. neither of which is correct. when they add the number to the end, it bypasses the section of the link that points to the post-title (which has a post number of something else like 67) and then goes straight to post number 106…
to be honest, I am completely confused here. I thought that the google and yahoo bots were supposed to be the so called “good” bots, but if they are doing things like this, then how can they be considered good? and being that they are hitting my site almost non-stop, they are just racking up my sites alotted bandwidth each month… I’ve tried using the bad behavior plugin to cut down on this, but it didn’t prevent yahoo and google from doing this and it eventually completely blocked me from accessing the site entirely because my provider, GoDaddy, does something like shadowing or whatnot…
does anyone know what can be done? is there a mod for the bad behavior plugin or some sort of alternative that I can use? I’d like to completely block the bad bots and possibly limit the so called “good” ones. i was hoping that others here were right and that they are just updating their lists, but almost two months have gone by with non-stop visits from all kinds of bots…
sorry, its just frustrating…
Thank you in advance,
Kahil
ok…
now i am getting bots trying to go to images on my site, and half the time they aren’t the right paths…
is there anything that i can do? a plugin like or modded version of bad behavior that I can use with my GoDaddy hosting?
can anyone please help? i’ve just checked my bandwidth used so far this month, and so far almost 9gigs have been used, most of which has been these damn bots…
thank you
Apparently anyone who has any thoughts has already posted what they think might help, as well as links to plugins which might also help.
no need to be a jerk about it vkaryl… if you can’t help, then why waste the time to be an asshole?
Blocking bad bots is a whole topic on it’s own. And a huge one at that. I would suggest looking over at http://www.webmasterworld.com/ and if you have really bad bots, get and use a spider trap:
http://www.google.co.uk/search?hl=en&q=php+spider+trap&btnG=Search&meta=
(top link – a direct link will be blocked)#Also try http://www.clockwatchers.com/robots_list.html and even a google for ‘block bad bots’ will turn up a lot of info.
Kahil – you want help ? BE POLITE.
thank you for the help podz!
EDIT..
Podz, i was being polite in all my requests for help here. vkaryl is the one who chose to respond with a smartass reply based soley on malcontent…there was no good intentions of his reply…
The topic ‘Robots…’ is closed to new replies.