Support » Fixing WordPress » about robots.txt file

  • my robots.txt file is shown below:

    User-agent: * Disallow: /wp-admin/ Disallow: /wp-includes/ Sitemap:
    <!–WP-HTML-Compression saved 0.93%. Bytes before:108, after:107–>

    does it mean, it has blocked the xml site map because it displays blocked URLs 13 and site is not doing well in search.
    i am very new to wordpress, so help me.

Viewing 4 replies - 1 through 4 (of 4 total)
  • Sitemap:
    User-agent: *
    Allow: /
    Disallow: /wp-admin/
    Disallow: /wp-includes/

    can i replace above code in robots.txt or i have to create new one.
    if so, will it be able to solve my problem which i have mentioned above.

    robots.txt is a suggestion only – protect the files and folders noted above as read only.

    ok thanks, but in webmasters tools crawler acess displays some blocked URLs, why this happens.

Viewing 4 replies - 1 through 4 (of 4 total)
  • The topic ‘about robots.txt file’ is closed to new replies.