WordPress.org

1. filmoreha
   Member
   Posted 1 year ago #

   Is there a way to prevent spidering of files in wp-content/uploads?

2. hey2you
   Member
   Posted 1 year ago #

   robot.txt

   http://www.robotstxt.org/orig.html

3. filmoreha
   Member
   Posted 1 year ago #

   Thanks hey2you. I already have some some directives in my robots.txt file, but I'm wondering if there's any extra layer of protection, for example maybe something interesting with .htaccess?

4. hey2you
   Member
   Posted 1 year ago #

   you want to lock it with .htaccess without letting others to access it through the site?? Try:

   http://www.elated.com/articles/password-protecting-your-pages-with-htaccess/

5. filmoreha
   Member
   Posted 1 year ago #

   Ah, thanks again. All I'm really trying to do is prevent files that I upload to a private site (very limited access) from being indexed/scraped. Maybe being a bit paranoid?

6. ClaytonJames
   Member
   Posted 1 year ago #

   more info:
   http://codex.wordpress.org/Search_Engine_Optimization_for_WordPress#Robots.txt_Optimization

Topic Closed

This topic has been closed to new replies.