I have just noticed that Google is picking up a virtual robot.txt file from my site that says;
I deleted my original robot.txt file on the instruction of the Google XML site map plugin, which states that the virtual robot.txt produced by WordPress will be used !
My question is this, surely the entered text in this virtual robot.txt file is incorrect..? would it not prevent my site from being crawled by any search engine bot..?
Can somebody clarify this point please..?
- The topic ‘WP virtual robot.text & Google XML Sitemap…?’ is closed to new replies.