WordPress.org

Ready to get started?Download WordPress

Forums

"A description for this result is not available b/c of robot.txt" message (3 posts)

  1. dburns
    Member
    Posted 1 year ago #

    When googling my site this message comes up.

    "A description for this result is not available because of this site's robots.txt – learn more."

    I went to my webmaster tools and it found this:

    User-agent: *
    Disallow: /wp-admin/
    Disallow: /wp-includes/

    Sitemap: http://www.baseballjobsoverseas.com/sitemap.xml.gz

    I did some research and am completely lost since i am noob. I am running a genesis theme and using it's SEO settings. Can anyone help me straighten this out?

    Thanks,
    BigD

  2. linux4me2
    Member
    Posted 1 year ago #

    Your robots.txt:

    User-agent: *
    Disallow: /wp-admin/
    Disallow: /wp-includes/

    is telling all search engines they are not allowed to look in the two directories that are listed.

    I would remove that section from the robots.txt file--or just comment it out temporarily--and re-test, though it may take a bit for the results of the change to show up on Google. You can comment it out with the "#" sign like this:

    #User-agent: *
    #Disallow: /wp-admin/
    #Disallow: /wp-includes/

    There is really no point in having them in there; they only give away your file structure. It's kind of like saying, "Oh, don't look here!" The 'bots you need to worry about are going to ignore your robots.txt file, anyway.

  3. dburns
    Member
    Posted 1 year ago #

    Thank linux4me2. I will give it a go and get to you if it worked.

Topic Closed

This topic has been closed to new replies.

About this Topic