WordPress.org

Author: Peter Coughlin

PC Robots.txt is an easy solution to creating and managing a robots.txt file for your blog. Instead of messing about with files and permissions, just upload and activate the plugin and you're done. It's another plugin designed for people like me, who just want to set stuff and forget it.

By default, the PC Robots.txt plugin has a bunch of spam-bots disallowed, Google bots specifically allowed, and a few of the standard WordPress folders and files disallowed. If you want to change what appears in your robots.txt file, you can easily edit the contents from the plugin options page under Settings, PC Robots.txt in your blog administration.

If the plugin detects an existing sitemap.xml file (or if you are using a copy of my pc-xml-sitemap plugin) a reference to sitemap.xml will be automatically added to your robots.txt file contents.

There's now an option for removing all plugin settings when de-activating the plugin. You'll find at the bottom of the plugin options page.