WordPress.org

Support

Support » Plugins and Hacks » [Plugin: WordPress SEO by Yoast] How to edit robots.txt file?

[Plugin: WordPress SEO by Yoast] How to edit robots.txt file?

Viewing 6 replies - 1 through 6 (of 6 total)
  • It should be just below .htaccess
    If you don’t see it, maybe you don’t have robots.txt in the root.

    Ya, I don’t see it. Here is my robots.txt file: http://www.discountqueens.com/robots.txt

    What is an easy way to find out where the file is, if it’s not in the root?

    I just checked mine again. After selecting SEO > Edit files, robots.txt appears first, .htaccess appears second.

    I see that you installed WordPress in the root so everything should work fine. Odd. Are you using the latest version of WordPress SEO?

    Yes, here is what I see: http://screencast.com/t/B74WX2fhxP9m

    I am using the version 1.1.5 of the plugin, is there a newer one? As for our wordpress install we’re still using version 3.2.1.

    Is there another place I should look?

    Very strange. I’m sorry, but I don’t have a clue :/

    I can help you out as this issue DROVE ME NUTS.

    1. I didnt have a Robots.txt
    2. I had Yoast installed
    3. Im pretty sure it created a Robots.txt even though it doesnt exist in my root (.com/here)
    4. My Google webmaster tools shows this

    User-agent: *
    Disallow: /wp-admin/
    Disallow: /wp-includes/
    Disallow: /cgi-bin
    Disallow: /wp-admin
    Disallow: /wp-includes
    Disallow: /wp-content/plugins
    Disallow: /plugins
    Disallow: /wp-content/cache
    Disallow: /wp-content/themes
    Disallow: /trackback
    Disallow: /feed
    Disallow: /comments
    Disallow: /category/*/*
    Disallow: */trackback
    Disallow: */feed
    Disallow: */comments
    Disallow: /*?*
    Disallow: /*?
    Allow: /wp-content/uploads
    Allow: /assets

    THIS IS HOW YOU FIX THIS ISSUE. Create a Robots.txt and only add this (or whatever you want. I keep it simple and rank well/have no issues at all. You CANT trick google)

    User-Agent: *
    Disallow: /wp-content/plugins/

    1. login to wordpress
    2. Click SEO in your side toolbar (Yoast WordPress Plugin settings).
    3. Go to edit files under SEO (in the side toolbar)

    And now you have the option to edit your Robots.txt file.

    🙂

Viewing 6 replies - 1 through 6 (of 6 total)
  • The topic ‘[Plugin: WordPress SEO by Yoast] How to edit robots.txt file?’ is closed to new replies.