WordPress.org

1. itmdesign
   Member
   Posted 6 months ago #

   Hi, I've recently been working on reducing the amount of duplicate content in my blog by denying robot access to category/archive pages etc.

   My website has a robots.txt in the root with the blog sitting in a subfolder. I've noticed that WordPress generates a robots.txt file that I can't seem to delete this file.

   Would it being there effect my robots.txt file in the root folder?

   Example of root robots:
   

   Disallow: /blog/wp-admin/
   Disallow: /blog/wp-content/
   Disallow: /blog/wp-includes/

   WordPress generated robots:
   

   User-agent: *
   Disallow:

Reply

You must log in to post.