WordPress.org

Ready to get started?Download WordPress

Forums

iThemes Security (formerly Better WP Security)
[resolved] Google was locked out of my site (3 posts)

  1. vanduzled
    Member
    Posted 1 year ago #

    Hi,

    I've just had my client's old site revamped and converted to wordpress and some of its pages are no longer available. I installed WP SEO and to my surprise, 404 Errors piled up my logs.

    I saw google was crawling to those pages that are now removed and so Google was lockedout. I cleared the lockout now but what will be the best way to handle those pages?

    I also installed a 404 redirect but do I have to redirect those pages (that google crawled and is not there anymore) so that it won't go to a 404 page? I redirected those pages that has .html in it like:

    /services.html -> /services/
    /about.html - > /about/

    But in my logs, those news pages and those pagination links are also being crawled by google.

    What's the best thing to do?

    Thank you!

    http://wordpress.org/extend/plugins/better-wp-security/

  2. Handoko
    Member
    Posted 1 year ago #

    1. I think the very first thing you need to do is whitelisting Google also other crawlers to prevent future blocking. To do it, goto menu > Security > Intrusion Detection > 404 White List > put the IPs there. Here are the IPs I put on mine, you may add more IP if there is any other you know:

    - 157.55.32.107 bingbot
    - 157.55.33.44 bingbot
    - 157.55.34.183 bingbot
    - 65.55.52.95 bingbot
    - 65.55.213.192 bingbot
    - 66.249.73.144 googlebot
    - 66.249.76.1 googlebot
    - 66.249.76.5 googlebot

    You may need to put your website IP too to prevent self blocking.

    2. You may need to (temporary) disable auto banning feature, goto menu > Security > Intrusion Detection > disable Blacklist Repeat Offender.

    3. Check the banned IPs. Goto menu > Security > Ban Users > Ban Hosts. Remove any good IP there (Google for example). You can use this ProjectHoneyPot to check the IP information:
    http://www.projecthoneypot.org/search_ip.php

    4. Release all the lockouts, goto menu > Security > View Logs > Current Lockouts > Release Lockout.

    5. The last and the most important thing is to avoid this problem to happens again in future. You need to study why this 404 error appear. Goto menu > Security > View Logs > 404 Errors > examine the pattern and fix it manually.

    FYI, based on my experiences, due to how this plugin work (modifying .htaccess), some 404 redirect plugins might not work correctly with this Better WP Security.

  3. vanduzled
    Member
    Posted 1 year ago #

    Thanks so much Handoko. Very precised and helpful tips from you. Will try this stuff.

Topic Closed

This topic has been closed to new replies.

About this Plugin

About this Topic