WordPress.org

1. maverickguy
   Member
   Posted 2 years ago #

   Hi,
   Im using the wp plugin for xml sitemap. When I go to google webmaster tools under html suggestions, I have duplicate title tags. For example:
   2009/10/page/2
   2009/10/page/3
   2009/10/page/4

   OR

   category/sports/mma/page/2
   category/sports/mma/page/3
   category/sports/mma/page/4

   How can I rename these archived pages so that google doesn't have a problem with them? Also, how can I easily view my sitemap? When I type my domain/sitemap.xml into the browser it comes up blank. But, google is crawling it still.

   Thanks!

2. maverickguy
   Member
   Posted 2 years ago #

   Bueller, Bueller? Anyone...?

3. lonelicloud
   Member
   Posted 1 year ago #

   I have the same problem. It's a theme side problem, I guess.

4. daves1997
   Member
   Posted 1 year ago #

   No help on this one?

5. Rev. Voodoo
   Volunteer Moderator
   Posted 1 year ago #

   I use robots.txt to block crawler access to category and date archives.

   No need for crawlers to go that route, since the articles can be accessed directly

6. daves1997
   Member
   Posted 1 year ago #

   How do you use the robots.txt to block crawler access?
   How would the archived articles be reached then?
   I am finding on google webmaster tools that I have duplicate title tags. i.e. community news, community news2 etc.

7. Rev. Voodoo
   Volunteer Moderator
   Posted 1 year ago #

   Duplicate stuff isn't that big of a deal. Google doesn't penalize for it.

   I block access for the sake of efficiency. I only want crawlers accessing content one way. Crawlers don't really need access to your archives. The same content is accessible through your index page, etc.

   Your post is available:
   --from your home page
   --author archive
   --date archive
   --category archive
   --etc....

   They are all inroads to the same content. It's great for users to have choices, but crawlers only need one road. If you block other roads, they just take the one you leave open

   If you want to block access to anything using robots.txt, just read up on it....

   you can view just about anyone's by visiting it!! It's web accessible obviously, so the bots can get to it
   http://www.rvoodoo.com/robots.txt
   is mine for instance

   I block all sorts of things for personal preference. My stuff all still shows up on google. Some people block nothing, and they are fine too. Really, you'll have to do some research and come up with your personal preference

Topic Closed

This topic has been closed to new replies.