WordPress.org

1. virtualvagabond
   Member
   Posted 9 months ago #

   Hi,

   Started my first blog and Google is indexing it, but not sure some of the results that are popping up in site:virtualvagabond.net should be there.
   As an example, there's often a result for a story and then another result for the picture used in that story.
   I'm assuming, since I don't see that with other sites, that I've done something wrong: and the more I read about what should and shouldn't be in the robots.txt the more confused I'm getting, since everyone seems to have their own ideas.
   Are there basic rules that should be followed? And if so, and I breaking them? My robots.txt file is:

   User-agent: *
   Disallow: /cgi-bin
   Disallow: /wp-admin
   Disallow: /wp-includes
   Disallow: /wp-content/plugins
   Disallow: /wp-content/cache
   Disallow: /wp-content/themes
   Disallow: /trackback
   Disallow: /comments
   Disallow: /category/*/*
   Disallow: /tag/
   Disallow: */trackback
   Disallow: */comments

   Thanks,

   Blair

Reply

You must log in to post.