Be very careful …

  • wordwiseweb

    (@wordwiseweb)


    1 month ago

    I appreciate the protection Blackhole for Badbots has given me for a couple of years, but suddenly I’m getting emails from Google saying their crawlers have been blocked and, within two days, my ranking has plummeted.
    I know the issue is the caching, and there are posts online about this for when the plugin’s used alongside Siteground’s Optimizer, but after obeying the instructions (there’s only one type of caching you’re supposed to use, apparently), after a lull of a week or so and getting a Google validation fix confirmation, I’m getting the Google emails again. Nothing’s changed in that time?
    I’m obeying the instructions, but still Google is being blocked? Why on earth would it block Google? Yes, I could stop using all caching, but then my site gets slower and that will also affect my ranking.
    I’ve had to deactivate the plugin, and I won’t be using it again. I’m hoping my Google ranking quickly recovers, as I spotted the drop fairly quickly. This will cost me money …

Viewing 4 replies - 1 through 4 (of 4 total)
  • Plugin Author Jeff Starr

    (@specialk)

    1 month ago

    Glad to help:

    1 – “I know the issue is the caching, and there are posts online about this for when the plugin’s used alongside Siteground’s Optimizer, but after obeying the instructions (there’s only one type of caching you’re supposed to use, apparently)”

    Yes, as explained countless times all over the place, plugin homepage, settings, Help tab, readme.txt, sticky posts, replies to other reviews, social media, blog posts, etc., any sort of *page cache* will prevent this plugin from working correctly. In other words, if your site is serving static pages, then dynamic plugins like Blackhole can’t work properly.

    2 – “Google is being blocked? Why on earth would it block Google?”

    This plugin explicitly whitelists (always allows) Google, Bing, and other major search engines. So when the instructions are carefully followed and no page caching is happening on site, it is impossible for the plugin to block Google. As explained, if there is any page caching, then of course the plugin can’t work correctly and things will break.

    3 – “I could stop using all caching, but then my site gets slower and that will also affect my ranking.”

    It would have been better to just follow the instructions and not use this plugin on any site that has page caching. I’m going to update the readme/docs again this time putting in all caps right up front: do NOT use this plugin on any site that has page caching. I’m not sure what else I can do? Do you have any ideas on how the instructions could have been more clear? If so, I would appreciate your input.

    Thread Starter wordwiseweb

    (@wordwiseweb)

    1 month ago

    Thanks for treating me as if I’m stupid, Jeff.

    Here’s what a post with your name on it says at https://plugin-planet.com/blackhole-pro-cache-plugins/

    “For newer versions of Siteground Optimizer cache plugin:

    • Disable “Dynamic Caching” (i.e., full page caching) and “File-Based Caching”
    • Empty/reset the cache before going live

    So basically, currently only the “Object Caching” feature works with Blackhole.”

    That’s exactly what I did because, contrary to what your post seems to suggest, I can read. Two types of caching were disabled, but object caching left on. Following those instructions has led to Google sending an email saying their crawler has been blocked. When I checked the robots. txt file, it had been altered by your plugin, and when I deactivate it, the txt file changes back again. Last time I did that, Google validated the fix, then I discovered your post, the one above, so reactivated the plugin, while following your instructions carefully and keeping only object caching on. Less than two weeks later, Google’s been blocked again.

    As the post above shows, your comment here that it doesn’t work with “any sort of *page cache*” clearly conflicts with that earlier advice, because it says object caching is fine. The post is from April 5 last year, and clearly needs removing so that more people don’t have problems.

    Plugin Author Jeff Starr

    (@specialk)

    1 month ago

    Sorry if my response was not better. I do apologize.

    Thanks for letting me know about Siteground Optimizer plugin, I will update the post information immediately. And in fact, from now on I am just going to say that *any sort of caching* is incompatible with this plugin. So page cache, object cache, JavaScript cache, content/partial cache, literally any sort of caching no longer is recommended for use with this plugin.

    I hope that eventually I am able to implement a solution that works with all the cache stuff out there. I have tried earnestly but there are many cache plugins each doing things their own way. I am working on it, just not there yet.

    Anyway, thanks for reporting this and even for the bad review — I deserve it for the incorrect information posted about Siteground Optimizer/object cache. I will try to do better. In fact, I am going to update the post right now, letting people know that Blackhole should NOT be used with any sort of caching, page-cache or otherwise. I will be updating the documentation and plugin settings, etc. as well with this new policy.

    Thread Starter wordwiseweb

    (@wordwiseweb)

    1 month ago

    Thanks for your reply, Jeff, and its honesty. Sorry for being a bit bolshy, but a plummeting Google ranking tends to do that, because it translates into hard cash. I’ve worked quite hard over years to get a number-one ranking, so anything affecting that gets both barrels. The ranking recovered quickly last time so, fingers crossed, there’s no lasting damage. I appreciate your prompt efforts to clarify things for others. Thanks for your hard work.

Viewing 4 replies - 1 through 4 (of 4 total)
  • You must be logged in to reply to this review.