WordPress.org

1. bamajr
   Member
   Posted 6 months ago #

   I'm using WP version 2.7.1 and I'm working on the SEO of my website.

   I just finished using the XML Sitemap Generator for WordPress 3.1.2 (Google XML Sitemaps plugin - which by the way only lists compatibility to WP version 2.7) The Sitemap was created and working fine! (see it here.)

   Now I'm working on a robots.txt file for web-bots. However I seem to be reading contradicting information on the wordpress.org site. There is a great deal of discussion about creating a robots.txt file yet there is also some chatter about WP automatically generating a virtual robots.txt file.

   So...

   Do I create an actual robots.txt file, or do I somehow modify the virtual robots.txt file?

2. talgalili
   Member
   Posted 4 months ago #

   I second this question - any one know the answer ?

3. iratherfly
   Member
   Posted 2 weeks ago #

   I am dealing with this too. My thought it to get a robots.txt plug-in that enables modifications to the virtual robots.txt. I am also having a problem with Google Webmaster Tools giving me a 404 not found robots.txt even though the virtual URL is working

Reply

You must log in to post.