I have in my "virtual" robots.txt file this:
User-agent: *
Disallow:
Disallow: */trackback*
Disallow: /wp-*
Disallow: */feed*
Disallow: /20*
User-Agent: MediaPartners-Google
Allow: /
And this line:
Disallow: /20*
block google to crawle your site, I found 540!! forbiden posts coz that line exist!
After research I found that this plugin do that SEO_Wordpress ... ahhh
