Questions about Google and the robots.txt file…
-
I have followed the guide on this site about SEO for wordpress and I will say that I am surprised on how well it does work… but I have a concern…
I followed the guide on how to setup the robot.txt (recommended setup for a wordpress site) and I see that it wants you to block things like posts and categories so that you don’t let google see duplicate content from… say …. your RSS feed.
My issue with this is that i studies my site stats and I see what people are searching for on google… and it’s great that my site comes up and even the information from the relevant post is under the link in google, but the link to the page is just my home page… not the relevant post.
I assume this is because of the robot.txt blocking google from seeing these directories… would it really hurt my rank to unblock these directories if I have a feedburner account? Anyone have any other suggestions about the robot.txt file.
Thanks for any help.
– James
- The topic ‘Questions about Google and the robots.txt file…’ is closed to new replies.