Support » Fixing WordPress » .htaccess is hijacking my robots.txt?

  • My .htaccess file has rewrite commands on it. I thought it was corrupted so I tried to take it down, but none of my interior pages were displaying. It seems to create a robots.txt that disallows access to my entire site…even when I upload a robots.txt file that allows all access. Here is what my .htaccess file is now…

    # BEGIN WordPress
    <IfModule mod_rewrite.c>
    RewriteEngine On
    RewriteBase /
    RewriteCond %{REQUEST_FILENAME} !-f
    RewriteCond %{REQUEST_FILENAME} !-d
    RewriteRule . /index.php [L]
    </IfModule>
    
    # END WordPress

    I welcome you much appreciated help in solving this mystery! Thank you!

Viewing 2 replies - 1 through 2 (of 2 total)
  • .htaccess won’t create a robots.txt, but it can be related to permalink problems, which can mess up links to interior pages. See:

    http://codex.wordpress.org/Using_Permalinks#Using_.22Pretty.22_permalinks

    robots.txt is only used by web robots like Google’s Googlebot and won’t affect regular visitors.

    Nevermind..the problem was not the .htaccess as you already would know. My webhosting company sent me on a wild goose chase. The problem was that Google retains the cached version of the file until it decides to read the new one…which in this case was about 24 hours.

Viewing 2 replies - 1 through 2 (of 2 total)
  • The topic ‘.htaccess is hijacking my robots.txt?’ is closed to new replies.