WordPress.org

Ready to get started?Download WordPress

Forums

[resolved] Robots.txt file problem using WordPress SEO by Yoast (3 posts)

  1. datemebg
    Member
    Posted 1 year ago #

    Hi,
    i have a problem with my robots.txt file.
    I was using Google XML Sitemaps and received messages in the webmaster tools that bots blocked my pages, i deleted the plugin and switched to SEO by Yoast, i enabled the XML Sitemaps.
    I tested the new sitemap in the webmaster tools and it says:

    Warnings

    Url blocked by robots.txt.

    Sitemap contains urls which are blocked by robots.txt.

    4

    Value: http://dateme.bg/category-sitemap.xml

    -

    Mar 19, 2013
    Value: http://dateme.bg/page-sitemap.xml

    -

    Mar 19, 2013
    Value: http://dateme.bg/post-sitemap.xml

    Here is my robots.txt file:
    # User-agent: *

    # Disallow: /wp-admin/

    # Disallow: /wp-includes/

    # Disallow: /wp-trackback

    # Disallow: /wp-feed

    # Disallow: /wp-comments

    # Disallow: /wp-content/plugins

    # Disallow: /wp-content/themes

    # Disallow: /wp-login.php

    # Disallow: /wp-register.php

    # Disallow: /feed

    # Disallow: /trackback

    # Disallow: /cgi-bin

    # Disallow: /comments

    # Disallow: *?s=

    I'm really sorry, but i have no idea what to do. I don't have any nofollow links or metatags..

    I will appreciate any help!
    Thank you

  2. datemebg
    Member
    Posted 1 year ago #

    P.S. i forgot to mention that i deleted the sitemaps.xml file from my root directory..

  3. datemebg
    Member
    Posted 1 year ago #

    that was before i installed SEO by Yoast

Topic Closed

This topic has been closed to new replies.

About this Topic