I read some discussions about search robot exklusion, but still I need to ask for help. I want to make search engines not index my website. This I know: There are two ways – using the robots tag in the head section of the web pages, and putting a robots.txt document with Disallow commands at the root of the web site. So far I’m informed.
Now, I am not sure of the details:
1) Where do I find the actual document of a blog post in WordPress? I can just see the post in the database of my site, but not real web page documents in HTML. So, where do I find the Head sections to put meta data as the robots tag in?
2) Where should I put the robots.txt document, and how should I refer to catalogs in it? I put a robots.txt in the httpdocs catalog, and only wrote disallow for the next level of catalogs. Do I need to put the txt file on another place, and should I mention catalogs on sub levels too?
- The topic ‘Where put robots tag and robots.txt?’ is closed to new replies.