WordPress.org

Ready to get started?Download WordPress

Forums

  1. danohawkaz
    Member
    Posted 1 year ago #

    My site is excluded from Google's search by keywords due to a robots.txt issue. I have re-done my robots file- checked it and still I get this notice under the site link: Dark Horse Media
    http://www.darkhorsemedia.com/
    A description for this result is not available because of this site's robots.txt

    I've removed the file- re-done it and still I have this message. What am I doing wrong? I'm using a custom theme- but it was working before we did some site improvements.

    Currently I have this robots.txt file in the root of my server- but it wasn't working before I uploaded this anyway. Any help appreciated!
    Line 1 User-agent: *
    Line 2 Disallow: /cgi-bin
    Line 3 Disallow: /wp-admin
    Line 4 Disallow: /wp-includes
    Line 5 Disallow: /wp-content
    Line 6 #Disallow: /show-error-
    Line 7 #Disallow: /*/feed
    Line 8 #Disallow: /*/feed/
    Line 9 #Disallow: /private
    Line 10 #Disallow:User-agent: Mediapartners-Google
    Line 11 #Disallow:User-agent: Adsbot-Google
    Line 12 #Disallow:User-agent: Googlebot-Image
    Line 13 #Disallow:User-agent: Googlebot-Mobile

    http://wordpress.org/extend/plugins/post/

  2. danohawkaz
    Member
    Posted 1 year ago #

    The line numbers are not in my text by the way- that was copied from http://tool.motoricerca.info/robots-checker.phtml

Topic Closed

This topic has been closed to new replies.

About this Plugin

About this Topic