WordPress.org

Forums

Help with robots.txt file (6 posts)

  1. risoknop
    Member
    Posted 6 years ago #

    Hello,

    I need a little help with my robots.txt file. I have been browsing the net for a while and reading various tutorials about robots.txt and how to make a proper robots.txt file for a wordpress blog. This is what I have put together:

    User-agent: *
    Disallow: /cgi-bin/
    Disallow: /wp-admin/
    Disallow: /wp-includes/
    Disallow: /wp-content/
    
    User-Agent: Mediapartners-Google
    Allow: /
    
    User-Agent: Adsbot-Google
    Allow: /
    
    User-Agent: Googlebot-Image
    Allow: /images/
    
    User-Agent: Googlebot-Mobile
    Allow: /
    
    Sitemap: http://seowebtips.com/sitemap.xml

    I'd like to ask whether it's good for a wordpress blog and especailly whether it won't harm my search engine rankings in a bad way.

    Thanks.

  2. risoknop
    Member
    Posted 6 years ago #

    Anybody?

  3. risoknop
    Member
    Posted 6 years ago #

    Bumpy bump.

  4. risoknop
    Member
    Posted 6 years ago #

    bump

  5. steverf
    Member
    Posted 6 years ago #

    I think you have a VERY GOOD question here...
    I am really interested in some expert responses here.
    I may be like you and not want to have my blog incoroporated into my site search engine.
    There has to be someone with some search engine experience here...

  6. ClaytonJames
    Member
    Posted 6 years ago #

Topic Closed

This topic has been closed to new replies.

About this Topic