WordPress.org

Ready to get started?Download WordPress

Forums

How do I stop search engines accessing a directory (6 posts)

  1. benleeke
    Member
    Posted 2 years ago #

    I am trying to stop google (and other search engines) accessing a particular directory.

    and I don't want the pages listed in that directory turning up in google serps.

    So I have put the pages in a directory and I am going to do the following.

    The directory that I want to restrict access to is /quotes

    1. Add

    User-agent: *
    Disallow: /quotes/

    to the robots.txt file.

    So now I have hopefully stopped google displaying results from within this directory.

    But will this also stop this page showing as well or do I need to do more?

    http://www.capabilityevents.co.uk/quotes/

  2. Samuel B
    moderator
    Posted 2 years ago #

    that should stop the whole folder from being indexed

  3. benleeke
    Member
    Posted 2 years ago #

    But will this also stop this page showing as well or do I need to do more?

    http://www.capabilityevents.co.uk/quotes/

  4. Samuel B
    moderator
    Posted 2 years ago #

    do you not want the page to show for anyone?

  5. benleeke
    Member
    Posted 2 years ago #

    I've solved the problem by installing Robots Meta plugin which gives me a small panel under the update or publish button. This allows me to spec noindex, nofollow which seems to do the trick.

    We use wordpress to produce quotes for clients. Even though these are password protected google still lists the pages and a snippet from the quote.

    So now with the Robots meta plugin, when we do a quote we just click the noindex, nofollow radio button and I hope google won't list the quote pages on their serps.

    Do you think this will work?

    Thanks for the help.

  6. Samuel B
    moderator
    Posted 2 years ago #

    ahh...sounds like a winner

Topic Closed

This topic has been closed to new replies.

About this Topic