Title: Robots.txt
Last modified: August 21, 2016

---

# Robots.txt

 *  [DanielThompsonUK](https://wordpress.org/support/users/danielthompsonuk/)
 * (@danielthompsonuk)
 * [12 years, 12 months ago](https://wordpress.org/support/topic/robotstxt-23/)
 * I am having some issues regarding robots.txt when I checked my site over using
   seoquake I noticed it didn’t have a robots.txt. I’m wondering why this could 
   be as I read wordpress automatically creates one. I have made sure I am set to
   indexable by search engines in the privacy settings but still I get a 404 page
   error when I try and access mydomain.com/robots.txt
 * Does anybody have any clues for how to fix this?
 * Many Thanks

Viewing 4 replies - 1 through 4 (of 4 total)

 *  [Krishna](https://wordpress.org/support/users/1nexus/)
 * (@1nexus)
 * [12 years, 12 months ago](https://wordpress.org/support/topic/robotstxt-23/#post-3768594)
 * That happens when you do not have a robots.txt file. Have you ever created and
   uploaded one?
 *  Thread Starter [DanielThompsonUK](https://wordpress.org/support/users/danielthompsonuk/)
 * (@danielthompsonuk)
 * [12 years, 12 months ago](https://wordpress.org/support/topic/robotstxt-23/#post-3768597)
 * Hey thanks for your response and nope I thought wordpress did it automatically?
   Is there any tutorials on here for how to upload one?
 * Thanks
 *  [Krishna](https://wordpress.org/support/users/1nexus/)
 * (@1nexus)
 * [12 years, 12 months ago](https://wordpress.org/support/topic/robotstxt-23/#post-3768601)
 *     ```
       User-agent: *
       Disallow: /wp-admin/
       Disallow: /wp-includes/
       ```
   
 * Just copy and paste the above code in a plain text editor like Notepad and save
   it as robots.txt and upload it to your root directory.
 *  [Krishna](https://wordpress.org/support/users/1nexus/)
 * (@1nexus)
 * [12 years, 12 months ago](https://wordpress.org/support/topic/robotstxt-23/#post-3768613)
 * Here are some links that will give you more info:
    [http://codex.wordpress.org/Search_Engine_Optimization_for_WordPress#Robots.txt_Optimization](http://codex.wordpress.org/Search_Engine_Optimization_for_WordPress#Robots.txt_Optimization)
   [http://support.google.com/webmasters/bin/answer.py?hl=en&answer=156449](http://support.google.com/webmasters/bin/answer.py?hl=en&answer=156449)
   [https://developers.google.com/webmasters/control-crawl-index/docs/robots_meta_tag](https://developers.google.com/webmasters/control-crawl-index/docs/robots_meta_tag)
   [http://www.robotstxt.org/faq.html](http://www.robotstxt.org/faq.html)

Viewing 4 replies - 1 through 4 (of 4 total)

The topic ‘Robots.txt’ is closed to new replies.

## Tags

 * [indexing](https://wordpress.org/support/topic-tag/indexing/)
 * [robots.txt](https://wordpress.org/support/topic-tag/robots-txt/)

 * In: [Fixing WordPress](https://wordpress.org/support/forum/how-to-and-troubleshooting/)
 * 4 replies
 * 2 participants
 * Last reply from: [Krishna](https://wordpress.org/support/users/1nexus/)
 * Last activity: [12 years, 12 months ago](https://wordpress.org/support/topic/robotstxt-23/#post-3768613)
 * Status: not resolved

## Topics

### Topics with no replies

### Non-support topics

### Resolved topics

### Unresolved topics

### All topics