I use subsites to create portals for my clients. Basically I've setup several sites: domain.som/site1, domain.com/site2 etc.
I would like to hide the complete content of these sites from Google and other search engines.
I believe there is a way to create a robots.txt and use some coding so they won't crawl these subsites.
Does anyone know the code and where to place the file on my server?