robots.text

  • Amirmaken

    (@amirmaken)


    12 years, 8 months ago

    I got this error message from google when I tried to submit the index_sitemap.xml file in google webmaster tools:
    “Sitemap contains urls which are blocked by robots.txt.”

    previously, I did not have a robots.txt file, yet wordpress seemed to have one which I could not find anywhere on my website.
    so I created a new robots.txt file and uploaded it to the server.

    Can anybody please help?

    http://www.basicfun.net/

Viewing 3 replies - 1 through 3 (of 3 total)
  • Krishna

    (@1nexus)

    12 years, 8 months ago

    You have the following code in your robots.txt

    User-agent: *
Disallow: /

    Is it the robots.txt file you uploaded?
    Just remove the second line that disallows all.

    Thread Starter Amirmaken

    (@amirmaken)

    12 years, 8 months ago

    Thanks Krishna for reply i type same code robots.text file

    User-agent: *
    Disallow: /

    but i see in google webmaster tool only 3 pages are indexed why not all of pagese are indexed
    please define me and provide the code which is the best for search engine

    Krishna

    (@1nexus)

    12 years, 8 months ago

    Just remove the second line that disallows all.

Viewing 3 replies - 1 through 3 (of 3 total)

The topic ‘robots.text’ is closed to new replies.