WordPress.org

1. Eve47
   Member
   Posted 1 year ago #

   Hi there,

   I want to make only one of my pages unsearchable by robots from any search engines, while keeping the rest of my website searchable. What is the most effective way to make this modification?

   Thanks!

2. ashifttech
   Member
   Posted 1 year ago #

   Hello,

   User-agent: *
   Disallow: /

   With the above declared, all robots (indicated by "*") are instructed to not index any of your pages (indicated by "/"). Most likely not what you want, but you get the idea.

   The following disallows all search engines and robots from crawling select directories and pages:

   User-agent: *
   Disallow: /cgi-bin/
   Disallow: /privatedir/
   Disallow: /tutorials/blank.htm

   If you would like to allow everything then your robots.txt should look like the following:

   User-agent: *
   Disallow:

   Hope this helps

Topic Closed

This topic has been closed to new replies.