WordPress.org

Forums

Google XML Sitemaps
Google says URL restricted by robots.txt (7 posts)

  1. jpw94
    Member
    Posted 1 year ago #

    Why does google webmaster tools keep saying URLS are restricted by my robots.txt?
    I do not have a robots.txt file in the home directory.
    I have unclicked discourage search engines.
    I use this google xml sitemaps plugin and ask that the home page be included in the virtual robots.txt
    When I go my site's robots.txt it shows:

    User-agent: *
    Disallow: /wp-admin/
    Disallow: /wp-includes/

    Sitemap: http://ravenwoodtennis.com/sitemap.xml.gz

    This doesn't seem to be blocking the home page, etc.

    PLUGIN RELATED: should I be changing the sitemap name to the sitemap_index.xml in the webmaster tools? If so, it's generating a 404 error. :-(

    https://wordpress.org/plugins/google-sitemap-generator/

  2. jpw94
    Member
    Posted 1 year ago #

    solved.

  3. kahrenr
    Member
    Posted 1 year ago #

    How did you solve? I've got the same problem.

  4. Carol Snelten
    Member
    Posted 1 year ago #

    I also have this problem. Can you please let me know how it was solved?

    Thank You

  5. aeicons
    Member
    Posted 1 year ago #

    Estou com o mesmo problema. Por favor, como vc resolveu.

  6. orgspirit2
    Member
    Posted 1 year ago #

    Hi,

    You can find solution here

  7. mhgold
    Member
    Posted 1 year ago #

    same problem with my client's website. http://www.mohexamnews.com/
    any help?

Topic Closed

This topic has been closed to new replies.

About this Plugin

  • Google XML Sitemaps
  • Frequently Asked Questions
  • Support Threads
  • Reviews

About this Topic