WordPress.org

1. xing3811
   Member
   Posted 1 year ago #

   In the WP Codex example of a robots.txt file, I am wondering what the purpose of these two lines are:

   Disallow: /*?*
   Disallow: /*?

   I understand those to mean to disallow all pages with a ? in the address. When I use that example robots.txt, Google Webmaster Tools says crawl error and lists pages with ? in the address, which just lead to pages like http://www.example.com/about. (I have permalinks set to %postname%.)

Topic Closed

This topic has been closed to new replies.