Bots are hogging our bandwidth!
Since installing wordpress+maya theme+woocommerce in July, we have noticed a steady increase in bandwidth consumption.
In the last month alone, we are seeing MILLIONS of hits and we think it is mostly by bots. Bots, most likely search engine bots, are crawling everything on our entire site every time we make any sort of change/update, regularly
I am going to either use a bots plug-in or write a robots.txt file myself.
What commands (follow/nofollow, index/noindex) do you recommend?
We are not using any kind of adsense either.
- The topic ‘Bots are hogging our bandwidth!’ is closed to new replies.