WordPress.org

1. David
   Member
   Posted 1 year ago #

   Hi,

   I have problem with the robots.txt file when using this plugin.

   As far as I understand, if you make changes to the indexation settings page it should automatically update the robots.txt file right?

   Well, my robots.txt file doesn't change. At first I didn't have one (just the virtual one that WP creates), so I created my own, but none of the disallow rules get added to it when I change it in the plugin.

   Any way to fix this?

   Thanks! :)

   http://wordpress.org/extend/plugins/wordpress-seo/

2. David
   Member
   Posted 1 year ago #

   I'm also having issues submitting my sitemap to google webmaster... I get this error:

   URL restricted by robots.txt
   We encountered an error while trying to access your Sitemap. Please ensure your Sitemap follows our guidelines and can be accessed at the location you provided and then resubmit.

3. Joost de Valk
   Member
   Posted 1 year ago #

   This plugin does nothing with your robots.txt file other than allowing you to edit it through the SEO -> Files section. The robots.txt is only one of the ways one can control what a search engine does, and frankly not a very good one.

4. David
   Member
   Posted 1 year ago #

   Hey Joost,

   thanks for the reply :) So when choosing to not have the login pages indexed it just adds a nofollow, noindex to the login page rather than changing the robots file?

   Any idea why the sitemap isn't being accepted? Do you have a link to a good robots.txt file example?

   Thanks,

   David

   P.S. - Thanks for making this awesome plugin! It could be easily be sold so really appreciate that you give it to us for free! :)

5. David
   Member
   Posted 1 year ago #

   Works now, logged in today and sitemap was accepted.

   Thanks anyway :)

6. Joost de Valk
   Member
   Posted 1 year ago #

   Glad to see you resolved it :)

Topic Closed

This topic has been closed to new replies.