Yoast SEO
[Plugin: WordPress SEO by Yoast] Robots.txt not found under Nginx? (5 posts)

  1. Hector
    Posted 5 years ago #

    I have installed Nginx as a reverse proxy on top of Apache (running on cPanel, CentOS 5.5, WP 3.05, WP SEO 0.4.1) and my Robots.txt is suddenly unreachable according to Google Webmaster. Do I have to manually create a redirect or edit an .htaccess (which under Nginx doesn't work anyway) ?

    Thanks so much for the advice!


  2. Joost de Valk
    Plugin Author

    Posted 5 years ago #

    My plugin doesn't do anything with robots.txt... Don't know what could cause that to be honest.

  3. Hector
    Posted 5 years ago #

    Ah, I thought the noindexes were written to a robots.txt. I will see what the error is then.

    But now... I recently upgraded the plugin from an earlier version that generated "sitemap.xml" and just come to realise the new one is not creating "sitemap_index.xml". Would that be needing an Nginx redirect? How can I force generate it?

    Thanks mate.

  4. Hector
    Posted 5 years ago #

    I just found this thread:


    And I can find the static sitemap.xml but I believe it is outdated from my previous version. What I also gathered is that there is no longer a physical XML but it rather gets generated on demand?

    That would mean I do need the Nginx redirect code or at least the path to the PHP, anyone know?


  5. TechHamlet
    Posted 4 years ago #

    In W3Total Cache, under Browser Cache, try to disable "Set W3 Total Cache header" for HTML & XML and then restart Nginx and try again! It worked for me :)

Topic Closed

This topic has been closed to new replies.

About this Plugin

  • Yoast SEO
  • Frequently Asked Questions
  • Support Threads
  • Reviews

About this Topic