Hello,
I need a little help with my robots.txt file. I have been browsing the net for a while and reading various tutorials about robots.txt and how to make a proper robots.txt file for a wordpress blog. This is what I have put together:
User-agent: *
Disallow: /cgi-bin/
Disallow: /wp-admin/
Disallow: /wp-includes/
Disallow: /wp-content/
User-Agent: Mediapartners-Google
Allow: /
User-Agent: Adsbot-Google
Allow: /
User-Agent: Googlebot-Image
Allow: /images/
User-Agent: Googlebot-Mobile
Allow: /
Sitemap: http://seowebtips.com/sitemap.xml
I'd like to ask whether it's good for a wordpress blog and especailly whether it won't harm my search engine rankings in a bad way.
Thanks.