When I first set up my site, I set wordpress to private, no indexing by search engines, while I worked on development. When I launched it, I changed the setting to allow all search engines.
Now Google won't index my site. The error message is this:
URL restricted by robots.txt [?]
Jun 12, 2007
The robots.txt file contents, as reported by google and by accessing the page http://www.ungeekit.com/robots.txt are this:
It seems to me those entries should allow all and not restrict any indexing whatsoever. (It's kind of a meaningless robots.txt file, actually.)
And on top of all that… when access the site files directly via FTP, I don't actually SEE the robots.txt file to delete it, or I would!
I'm probably just not comprehending something basic about the use of robots.txt or the privacy setting in WordPress, or missing something in my file structure, but this is driving me nuts. Any suggestions would be welcome – thanks!