• Resolved Michael

    (@michael8888)


    It appears StopBadBots does not work if the W3 Total Cache plugin cached a page. That is, bots that are supposed be blocked can access pages that have been cached by the W3 Total Cache plugin.

    Is there a way to use both plugins together?

Viewing 13 replies - 1 through 13 (of 13 total)
  • Plugin Author sminozzi

    (@sminozzi)

    Hi Michael,
    First of all, request to w3 total cache the name of their bot.
    Then, go to the bot’s table and disable that bot.
    For more details, take a look our startup guide and our on line guide.
    Cheers,
    Bill

    Thread Starter Michael

    (@michael8888)

    sminozz, thanks for the reply. I think you misunderstood my post. W3 Total Cache is not a bot. It is a very popular caching plugin that runs on many big sites. W3 Total Cache makes your plugin useless because even if StopBadBots is enabled ALL bots can access the site. The reason is that W3 Total Cache loads pages from its cache and StopBadBots has no chance to intervene anymore.

    Plugin Author sminozzi

    (@sminozzi)

    Hi Michael,
    Check if you have free memory. I suggest to you take a look our troubleshooting page:
    http://siterightaway.net/troubleshooting/
    For a quick response, use our support page:
    http://billminozzi.com/dove/
    Cheers,
    Bill

    Thread Starter Michael

    (@michael8888)

    Bill, I am afraid you still don’t understand. This is not a troubleshooting case. Your plugin is incompatible with W3 Total Cache which is one of the most popular plugins for big sites. Actually, I think StopBadBots currently does not work with most caching plugin because most of them redirect traffic via .htaccess and StopBadBots code will then not executed anymore.

    This means that exactly those sites that would be interested in paying for the premium version, can’t use StopBadBots.

    My guess is that you have to work with JavaScript because this code is also executed if the HTML page comes from a cache.

    Plugin Author sminozzi

    (@sminozzi)

    Hi Michael,

    I just run tests with W3 total cache in one site with our plugin stop bad bots and works fine.

    Double check if you have memory available in your site. Stop Bad Bots has a tab in dashboard. Take a look that.
    Look also your console log for javascript errors.

    Take a look our troubleshooting page for more suggestions.
    http://siterightaway.net/troubleshooting/

    If you have our premium version, please, fill out one ticket in our site and we can take a look for you.
    http://billminozzi.com/dove/

    Cheers,
    Bill

    Thread Starter Michael

    (@michael8888)

    Memory Checkup says I have 256MB and 8MB are used.

    StopBadBots only works when a certain page is accessed the first time because the page is then not yet in the cache. If you access the page a second time with a bot (I tried wget), StopBadBots no longer recognizes the bot.

    You also have to make sure that you configured W3 Total Cache properly, that is that you enabled all caches (pages, objects, MySQL etc.) You also have to check if the delivered page really comes from the cache. There are plenty of ways to mess up a WTC configuration.

    Plugin Author sminozzi

    (@sminozzi)

    I installed in 3 more sites (pages, objects, MySQL).
    I will keep an eye on and let you know later or tomorrow.

    Plugin Author sminozzi

    (@sminozzi)

    Hi Michael,

    I made tests in 3 sites, works fine.
    Our plugin blocked bots with w3 total cache installed.
    Blocked: Exbot,zgrab, cfnetwork
    My options: cache pages, objects, MySQL.
    Probably you have problems with another plugin or some server/configuration incompatibility.

    Cheers,
    Bill

    Thread Starter Michael

    (@michael8888)

    Did you verify that the page was delivered from the WTC cache? You can configure WTC in test mode. You can then see on the delivered page that it comes from cache.

    I tested it many times. Whenever I disable WTC, StopBadBots works fine. I then enable W3TC and load a certain page and StopBadBots still blocks the bot. wget will then store an empty index.html. But I when I load exactly the same page a second time, wget will download the page.

    Plugin Author sminozzi

    (@sminozzi)

    I checked enable in General Settings page.

    Plugin Author sminozzi

    (@sminozzi)

    I tried also access with wget and i got one empty file. Works fine!
    Then, sorry, i’m unable to replicate your issue in our server.

    Thread Starter Michael

    (@michael8888)

    Did you verify that pages are served from the cache? This article explains how you can verify if WTC is working: https://www.webnots.com/how-to-check-w3-total-cache-is-working-on-your-wordpress-site/

    Note that is usually not enough to just install and configure WTC. You usually need to do a few things on the server.

    It would be a miracle if Stopbadbots works with WTC. Like most caching plugins WTC modifies .htaccess and redirects the web server to load pages directly from the cache. This means that WordPress plugins are no longer involved in page delivery once the page is in the cache. This is the very point of caching because PHP it the main reason for slow page delivery. This means that Stopbadbots no longer “sees” page requests that are in the cache and can therefore not block such requests.

    What you need to do is to work with Javascript or add all your bots to .htaccess and block access there. The latter would make sense anyway because this way the bots consume less server resources.

    • This reply was modified 7 years, 5 months ago by Michael. Reason: changed link
    Plugin Author sminozzi

    (@sminozzi)

    Hi Michel,

    I will explain what i did:

    1) I enabled the basic cache. (pages, objects, MySQL)
    2) After that, my pages load faster. (around 30% faster). Also if i empty the browser cache.
    3) I went to my root and did a wget (to open my site). The page comes empty. (works!)
    4) I received emails about bots doing blocked.

    Then, the site loads faster (for me cache plugin works) and the bots are blocked.
    In this moment, i have no time available to do more tests, because i’m in the middle of a lot of jobs – included migrating around 150 sites mine to a new server –

    I’m unable to replicate in my server what you told me but i appreciated yours information and suggestions, i will keep an eye on.

    Cheers,

    Bill

Viewing 13 replies - 1 through 13 (of 13 total)

The topic ‘StopBadBots – W3 Total Cache incompatibility’ is closed to new replies.