SpyRobots on Weblogs (2 posts)

  1. James Huff
    Volunteer Moderator
    Posted 11 years ago #

    It's no threat. Well, it is, but no more than Google. Thanks to search sites which also use bots, like Google, there is no such thing as a "private blog" unless you use robots.txt: http://www.robotstxt.org/wc/exclusion.html http://www.robotstxt.org/wc/norobots.html

  2. Mark McKibben
    Posted 11 years ago #

    And using robots.txt is no guarantee because not all web spiders respect that file. The only real way to have a completely "private blog" would be to never publish it online.

Topic Closed

This topic has been closed to new replies.

About this Topic


No tags yet.