Forums

How do I stop pages from being followed by spiders (2 posts)

  1. michaelgs
    Member
    Posted 1 year ago #

    I have some affiliate websites. The newest Google Panda update and the new landing page definition of bridge page have really hurt my income.
    I would like to try a work around but in order to do that I need to stop the Google spider (or all spiders) from reading or indexing my pages other then my homepage.
    in other words I need to set my homepage up in such a manner that the spider will follow all links except those which lead to another page.
    Can anyone here help me?
    can this be done via robot.txt or via .htaccess?
    I appreciate your help.
    Michael

  2. zoonini
    help me help you
    Posted 1 year ago #

    You can try the "nofollow" meta tag on the homepage only. This should in theory allow the homepage to be indexed, but tell spiders not to follow any links. Example:

    <meta name="robots" content="nofollow" />

    Reference: http://www.seoconsultants.com/meta-tags/robots/

    You can use the is_front_page() conditional tag to code this in your header.php so that the line only appears on your homepage.

Topic Closed

This topic has been closed to new replies.

About this Topic