search engines, permissions, and robots.txt
This is the first time I have used php for a web site.
First of all, I have set the permissions on the php files to 604, and things seem to be working as expected. Will this cause problems for search engine spiders, like googlebot?
For search engines, what happens if I disallow access to the php files so that they will not be spidered. Does this prevent search engines from picking up the content? Is disallowing access to php files a good idea? A bad idea? Clearly I have no idea!
Is there a good tutorial on this somewhere
- The topic ‘search engines, permissions, and robots.txt’ is closed to new replies.