lazphil

Hi,

I have exactly the same problem.

I followed the procedure, but google still can’t access my robots.txt file

I have installed yoast, and everything was fine, i think the problem came when created the sitemap file.

I updated the robots.txt file to add the link to the sitemap. But since google can’t access that file it doesn’t change anything.

When i submit the sitemap to google, it says everything is fine. But still an error message for the robots file.

I have updated the robots file, but when i go on the tool for testing the robots file, the default content is still the old content. I look as if google can’t the see update of the robot file.

this is the real content of my robots.txt

User-agent: *
Disallow: /wp-admin/
Disallow: /wp-includes/
Disallow: /wp-content/uploads/
Disallow: /wp-content/plugins/
Disallow: /wp-content/themes/
Disallow: /wp-content/cache/

Sitemap: http://www.technologiesdinterieur.com/sitemap_index.xml

and this is the default content on google tools

User-agent: *
Disallow: /wp-admin/
Disallow: /wp-includes/

So it looks the last explored version of the robot is the 6 may. and since then my changes on the robot can’t be read.

please help, i become crazy

http://www.technologiesdinterieur.com
http://www.technologiesdinterieur.com/robots.txt
http://www.technologiesdinterieur.com/sitemap_index.xml