whenever I type mysitename.com/robots.txt in my browser I get error 404 - not found. It's a new, clean installation of wordpress 2.8 with the following plugins active: contact form 7, customize(for freshy 2.0 theme), google xml sitemaps, wordpress.com stats and wp-mythumshot
site is not yet properly indexed by google although it is only a few days old.
I tried installing PC Robots.txt plugin but still get error 404 when trying to reach sitename.com/robots.txt
why is this and what should I do? should I create robots.txt manually and add all content including sitemaps.xml to it? (and disable "Add sitemap URL to the virtual robots.txt file." in google sitemaps xml plugin)
My site is not big, it's only like 5 or so pages in size.