Forum Replies Created

Viewing 3 replies - 1 through 3 (of 3 total)
  • Thread Starter Sarah_Harvey

    (@sarah_harvey)

    Actually just a bit further down I saw this post:

    # Otto Says:
    June 20th, 2008 at 3:39 pm

    I’m Otto, a moderator on the WordPress.org support forums.

    The latest versions of WordPress DO generate robots.txt files via rewrites, if there is no robots.txt file already present in the main WordPress directory.

    If you go to the Settings->Privacy menu option in WordPress, then you’ll see an option there that changes WordPress to block or allow search engines to index the site. If you switch this, then you’ll notice the “pretend” robots.txt file changes.

    So yes, WordPress is absolutely generating this fake file. GoDaddy hosting is NOT at fault here.

    ——————

    I actually switched the option in wordpress to allow all things almost two days ago, unless it takes a while to happen?

    Thread Starter Sarah_Harvey

    (@sarah_harvey)

    Yes, thanks…I actually found a thread on the net somewhere else that explains it perfectly and just uploaded my robots.txt file and it over-wrote this phantom robots.text file. Believe me when I say it wasn’t present in my installation directory or anywhere in the sub directories. I had a damn good look. I can only assume its the rewrite rule as they stated.

    Read it all here:

    http://www.squareoak.com/blog/godaddy-phantom-robotstxt-files/

    Thread Starter Sarah_Harvey

    (@sarah_harvey)

    Believe me when I say it isn’t in the root directory of topgolfmembership.

    I used the quick install from godaddy for wordpress and I cannot find this robots.text anywhere. I am looking through it now as I am typing it… again.

    Anyway, I will sort the robots.text…I would still love to find out how to deal with the formatting problem. Can anyone help with that?

    Thanks for letting me know there is a robots.text though…I thought I was going mad.

Viewing 3 replies - 1 through 3 (of 3 total)