Forums

Google issues with robots.txt (6 posts)

  1. genia95
    Member
    Posted 1 year ago #

    When I noticed that Google was unable to read my sitemap anymore since
    about a couple of weeks now (without any changes having been made to
    my site), I had a look into Google Webmaster Tools and found out that
    apparently, Google is now unable to access my robots.txt file. I tried
    to access it with "Fetch as Google", but all I get is the error
    message "Missing robots.txt". When I try to access the file in my
    browser by entering the URL manually, everything works fine. Other
    search engines such as Yahoo continue to crawl my site without any
    problems whatsoever.

    To make sure the problem is not located inside of the robots.txt file,
    I used Google Webmaster Tools to create a new robots.txt file,
    uploaded it into wordpress and replaced the old one with it - with the
    same result.

    I have WordPress installed on all of my domains, just having issues with 2 of them.

    Help?

  2. zoonini
    help me help you
    Posted 1 year ago #

    Can you provide a link to your site?

  3. genia95
    Member
    Posted 1 year ago #

  4. zoonini
    help me help you
    Posted 1 year ago #

    In your robots.txt, try changing

    Sitemap: http://11daydiet.org/sitemap.xml.gz

    to

    Sitemap: http://11daydiet.org/sitemap.xml

    .gz is a compressed format.

    Also be sure you have no blank lines at the end of your robots.txt file.

    If you continue to have issues, you may want to post in the Google help forums.

  5. genia95
    Member
    Posted 1 year ago #

    Tried that already, its not working. What do you mean by " no blank lines at the end of the robots.txt file?

  6. zoonini
    help me help you
    Posted 1 year ago #

    Put your cursor in the file and remove any blank space after the last piece of text.

    I would really encourage you to post your issue in the Google help forums - good luck.

Topic Closed

This topic has been closed to new replies.

About this Topic