robots.txt and SEO
I was told to use this code to avoid issues of duplicate content with Google, but at the same time I am using Categories as my main navigation and I think that it would be better to get it indexed, since I am using a lot of keywords in category names (actually 100% of them are keywords). I was also going to add Categort descriptions and display them on pages to further improve SEO.
So basically I am wondering if there is a way to get around that and spider categories as navigation and allow spidering category pages (with h1 tags that I want to create) and at the same time avoid issues related to duplicate content etc…
- The topic ‘robots.txt and SEO’ is closed to new replies.