Bots are hogging our bandwidth! (1 post)

  1. MrPlow
    Posted 3 years ago #

    Since installing wordpress+maya theme+woocommerce in July, we have noticed a steady increase in bandwidth consumption.

    In the last month alone, we are seeing MILLIONS of hits and we think it is mostly by bots. Bots, most likely search engine bots, are crawling everything on our entire site every time we make any sort of change/update, regularly

    I am going to either use a bots plug-in or write a robots.txt file myself.
    What commands (follow/nofollow, index/noindex) do you recommend?

    We are not using any kind of adsense either.

Topic Closed

This topic has been closed to new replies.

About this Topic


No tags yet.