Forums

Robots in Action - Yahoo! (1 post)

  1. Big Moose
    Member
    Posted 1 year ago #

    Thought that'd get some of you excited. But nope ... it's just the Moose Monster trying to figure this stuff out.

    So I learned that adding a robots.txt file to my root directory will block my site from being indexed, which can be beneficial while it's being developed. I can still pull up my website, but I'm trusting that it's not being indexed. Questions:

    1) How can I check that my robots.txt is working?
    2) How can I block people from seeing my website but still be able to see it myself while working on the design?
    3) People seem to feel they need to keep a robots.txt file at all times. Why?

    Oh, what fun on a Friday night!!!

    Big Moose

Topic Closed

This topic has been closed to new replies.

About this Topic