Robots in Action – Yahoo!
-
Thought that’d get some of you excited. But nope … it’s just the Moose Monster trying to figure this stuff out.
So I learned that adding a robots.txt file to my root directory will block my site from being indexed, which can be beneficial while it’s being developed. I can still pull up my website, but I’m trusting that it’s not being indexed. Questions:
1) How can I check that my robots.txt is working?
2) How can I block people from seeing my website but still be able to see it myself while working on the design?
3) People seem to feel they need to keep a robots.txt file at all times. Why?Oh, what fun on a Friday night!!!
Big Moose
- The topic ‘Robots in Action – Yahoo!’ is closed to new replies.