Meta tags - How to make a page unsearchable (2 posts)

  1. Eve47
    Posted 5 years ago #

    Hi there,

    I want to make only one of my pages unsearchable by robots from any search engines, while keeping the rest of my website searchable. What is the most effective way to make this modification?


  2. ashifttech
    Posted 5 years ago #


    User-agent: *
    Disallow: /

    With the above declared, all robots (indicated by "*") are instructed to not index any of your pages (indicated by "/"). Most likely not what you want, but you get the idea.

    The following disallows all search engines and robots from crawling select directories and pages:

    User-agent: *
    Disallow: /cgi-bin/
    Disallow: /privatedir/
    Disallow: /tutorials/blank.htm

    If you would like to allow everything then your robots.txt should look like the following:

    User-agent: *

    Hope this helps

Topic Closed

This topic has been closed to new replies.

About this Topic