Ready to get started?Download WordPress


How do I stop pages from being followed by spiders (2 posts)

  1. michaelgs
    Posted 2 years ago #

    I have some affiliate websites. The newest Google Panda update and the new landing page definition of bridge page have really hurt my income.
    I would like to try a work around but in order to do that I need to stop the Google spider (or all spiders) from reading or indexing my pages other then my homepage.
    in other words I need to set my homepage up in such a manner that the spider will follow all links except those which lead to another page.
    Can anyone here help me?
    can this be done via robot.txt or via .htaccess?
    I appreciate your help.

  2. You can try the "nofollow" meta tag on the homepage only. This should in theory allow the homepage to be indexed, but tell spiders not to follow any links. Example:

    <meta name="robots" content="nofollow" />

    Reference: http://www.seoconsultants.com/meta-tags/robots/

    You can use the is_front_page() conditional tag to code this in your header.php so that the line only appears on your homepage.

Topic Closed

This topic has been closed to new replies.

About this Topic