This may be a dumb question, but… 🙂
I’ve set up my robots.txt file based off the sample in the WP Codex at: http://codex.wordpress.org/Search_Engine_Optimization_for_WordPress
However, I’ve been curious as to why one would allow the indexing of:
The reason I ask is because I have a photo blog, and I try to be protective of the images on my website. For instance, I definitely concur with disallowing Google-bot Image.
I’m contemplating NOT allowing the indexing of the /wp-content/uploads. Would there be an unintended negative consequence to doing that?
Any clarification on why /wp-content/uploads is allowed in the sample robots.txt would be appreciated.
Thanks so much for any assistance.
- The topic ‘robots.txt question’ is closed to new replies.