about robots.txt file (5 posts)

  1. mbwani
    Posted 4 years ago #

    my robots.txt file is shown below:

    User-agent: * Disallow: /wp-admin/ Disallow: /wp-includes/ Sitemap: http://filmmovienew.com/sitemap.xml.gz
    <!--WP-HTML-Compression saved 0.93%. Bytes before:108, after:107-->

    does it mean, it has blocked the xml site map because it displays blocked URLs 13 and site is not doing well in search.
    i am very new to wordpress, so help me.

  2. adpawl
    Posted 4 years ago #

    Sitemap: http://filmmovienew.com/sitemap.xml.gz
    User-agent: *
    Allow: /
    Disallow: /wp-admin/
    Disallow: /wp-includes/
  3. mbwani
    Posted 4 years ago #

    can i replace above code in robots.txt or i have to create new one.
    if so, will it be able to solve my problem which i have mentioned above.

  4. Pioneer Web Design
    Posted 4 years ago #

    robots.txt is a suggestion only - protect the files and folders noted above as read only.

  5. mbwani
    Posted 4 years ago #

    ok thanks, but in webmasters tools crawler acess displays some blocked URLs, why this happens.

Topic Closed

This topic has been closed to new replies.

About this Topic