• I got this error message from google when I tried to submit the index_sitemap.xml file in google webmaster tools:
    “Sitemap contains urls which are blocked by robots.txt.”

    previously, I did not have a robots.txt file, yet wordpress seemed to have one which I could not find anywhere on my website.
    so I created a new robots.txt file and uploaded it to the server.

    Can anybody please help?

    http://www.basicfun.net/

Viewing 3 replies - 1 through 3 (of 3 total)
  • You have the following code in your robots.txt

    User-agent: *
    Disallow: /

    Is it the robots.txt file you uploaded?
    Just remove the second line that disallows all.

    Thread Starter Amirmaken

    (@amirmaken)

    Thanks Krishna for reply i type same code robots.text file

    User-agent: *
    Disallow: /

    but i see in google webmaster tool only 3 pages are indexed why not all of pagese are indexed
    please define me and provide the code which is the best for search engine

    Just remove the second line that disallows all.

Viewing 3 replies - 1 through 3 (of 3 total)

The topic ‘robots.text’ is closed to new replies.