Bandwidth and bad_bots
-
I’ve read, read again and tried things, but to no avail, so I’ve scrapped my robots.txt and attempts at bot blocking with .htaccess
My site is being eaten to the tune of over 100meg/day, the majority of that being bots. A couple of known search engines is fine, but bots from heaven knows where is daft, and I want them gone.
I’ve read stuff at webmasterworld, diveintomark and more, but could anyone point me at something that is easy to setup / understand / use that will either block the scavengers or that I can easily configure ?
I know a perfect solution does not exist, but seeing as all my own attempts have failed, any guidance would be gratefully recieved.
Viewing 5 replies - 1 through 5 (of 5 total)
Viewing 5 replies - 1 through 5 (of 5 total)
- The topic ‘Bandwidth and bad_bots’ is closed to new replies.