WordPress.org

Ready to get started?Download WordPress

Forums

WordPress SEO by Yoast
Robots.txt (2 posts)

  1. ehquionest
    Member
    Posted 2 years ago #

    Hello,
    just to know if I have to create a robots.txt file and upload it or not ?
    Thank you !
    Samuel

    http://wordpress.org/extend/plugins/wordpress-seo/

  2. Edward Seid
    Member
    Posted 2 years ago #

    robots.txt isn't required BUT it is recommended.

    I have a default one that I use on all my WordPress installations, shared below.

    robots.txt

    User-agent: *
    Disallow: /cgi-bin/
    Disallow: */wp-*
    Disallow: *.php
    Disallow: */feed*
    Disallow: */trackback*
    Allow: */wp-content/uploads*
    
    Sitemap: http://yourdomain.com/sitemap_index.xml

Topic Closed

This topic has been closed to new replies.

About this Plugin

About this Topic