WordPress.org

1. benleeke
   Member
   Posted 6 months ago #

   I am trying to stop google (and other search engines) accessing a particular directory.

   and I don't want the pages listed in that directory turning up in google serps.

   So I have put the pages in a directory and I am going to do the following.

   The directory that I want to restrict access to is /quotes

   1. Add

   User-agent: *
   Disallow: /quotes/

   to the robots.txt file.

   So now I have hopefully stopped google displaying results from within this directory.

   But will this also stop this page showing as well or do I need to do more?

   http://www.capabilityevents.co.uk/quotes/

2. Samuel B
   moderator
   Posted 6 months ago #

   that should stop the whole folder from being indexed

3. benleeke
   Member
   Posted 6 months ago #

   But will this also stop this page showing as well or do I need to do more?

   http://www.capabilityevents.co.uk/quotes/

4. Samuel B
   moderator
   Posted 6 months ago #

   do you not want the page to show for anyone?

5. benleeke
   Member
   Posted 6 months ago #

   I've solved the problem by installing Robots Meta plugin which gives me a small panel under the update or publish button. This allows me to spec noindex, nofollow which seems to do the trick.

   We use wordpress to produce quotes for clients. Even though these are password protected google still lists the pages and a snippet from the quote.

   So now with the Robots meta plugin, when we do a quote we just click the noindex, nofollow radio button and I hope google won't list the quote pages on their serps.

   Do you think this will work?

   Thanks for the help.

6. Samuel B
   moderator
   Posted 6 months ago #

   ahh...sounds like a winner

Reply

You must log in to post.