I want to protect my important files like databases and configuration and passwords. And now Im trying to construct robot.txt so that Search Engines can look at my posts and categories but not on the subjects mentioned above. Is there any angels there to help me with a sample robot.txt which can improve my traffic and visibility? Are there any plug-ins I can use. Thank you very much
- The topic ‘What are important files should be excluded for robot.txt access’ is closed to new replies.