Ready to get started?Download WordPress


[resolved] Privacy Settings - robots.txt (7 posts)

  1. charmedattic
    Posted 4 years ago #


    I'm doing a soft launch for my company's corporate blog and as such, it should be restricted to normal visitors only. As such, I understand that if we click on the Privacy settings "I would like to block search engines, but allow normal visitors" will cause "<meta name='robots' content='noindex,nofollow' />" to be generated into the <head> </head> section (if wp_head is used) of your site's source, causing search engine spiders to ignore your site.

    Hence, is there a need to manually create robots.txt in the root folder? Or will it be automatically created once we turn on that setting?

    How will the robots.txt be affected once I decided to open my blog to search engines?

  2. No, a virtual robots.txt file will be created, so there's no need to make a physical one. Once you deactivate the privacy settings, you can safely create your own robots.txt file.

  3. charmedattic
    Posted 4 years ago #

    So once I deactivate the privacy setting, creating my own robots.txt file wouldn't clash with the virtual file I assume?

  4. That's correct. The virtual robots.txt checks for the existance of a physical robots.txt before enabling itself.

  5. charmedattic
    Posted 4 years ago #

    Ok thank you for your help! :)

  6. You're welcome!

  7. worldfreenews
    Posted 3 years ago #

    I have created and placed a robots.txt in my root directory and it is not being recognized. I had privacy set to block engines then, upon changing the setting to allow engines, Google bots are still blocked. Verified using webmaster tools. Robot.txt file I created is not over-riding the virtual file nor is the virtual file updating to the setting of allow all. Please help.

Topic Closed

This topic has been closed to new replies.

About this Topic