Keeping Google spiders away from a page
-
i have a few pages on my site that I don’t want anyone to have access to unless I give them the direct URL. On my old FrontPage site, if a page wasn’t connected to the chain from the home page, it wasn’t crawled and I was safe. I assumed WP would work the same way, but to my shock, Googling a phrase that is on a page not connected to any menus brought up that page!
I don’t know what Google is doing with WP that allows it to spider to pages on a site that are not hooked in any way to menus, but how do i tell the webcrawlers like Google to not crawl a given page?
And is there anything I can do to make those Google hits go away, other than hope future crawlings won’t hit those pages after I implement whatever you suggest? Some private info is now visible on Google even before one clicks through…just based on the three lines that show up in the search.
The topic ‘Keeping Google spiders away from a page’ is closed to new replies.