Robotstxt Help

  • producertravis

    (@producertravis)


    16 years, 4 months ago

    I need help. When I logged into google web stats, it says that mydomain.com/robotstxt is not allowing googlebot to crawl. Therefore my content isn’t getting indexed.

    How do I delete this and let google crawl it all. I do not see that file anywhere when using an ftp agent to view the server. Do I change this in wordpress

Viewing 1 replies (of 1 total)
  • Bobcat

    (@bobcat)

    16 years, 3 months ago

    Simply go to mydomain.com/robots.txt (note the . before txt) with a web browser. What do you see? Cut and paste it here (or tell us the domain so we can look for ourselves).

Viewing 1 replies (of 1 total)
  • The topic ‘Robotstxt Help’ is closed to new replies.