"A description for this result is not available b/c of robot.txt" message

  • dburns

    (@dburns)


    11 years, 4 months ago

    When googling my site this message comes up.

    “A description for this result is not available because of this site’s robots.txt – learn more.”

    I went to my webmaster tools and it found this:

    User-agent: *
    Disallow: /wp-admin/
    Disallow: /wp-includes/

    Sitemap: http://www.baseballjobsoverseas.com/sitemap.xml.gz

    I did some research and am completely lost since i am noob. I am running a genesis theme and using it’s SEO settings. Can anyone help me straighten this out?

    Thanks,
    BigD

Viewing 2 replies - 1 through 2 (of 2 total)
  • linux4me2

    (@linux4me2)

    11 years, 4 months ago

    Your robots.txt:

    User-agent: *
Disallow: /wp-admin/
Disallow: /wp-includes/

    is telling all search engines they are not allowed to look in the two directories that are listed.

    I would remove that section from the robots.txt file–or just comment it out temporarily–and re-test, though it may take a bit for the results of the change to show up on Google. You can comment it out with the “#” sign like this:

    #User-agent: *
#Disallow: /wp-admin/
#Disallow: /wp-includes/

    There is really no point in having them in there; they only give away your file structure. It’s kind of like saying, “Oh, don’t look here!” The ‘bots you need to worry about are going to ignore your robots.txt file, anyway.

    Thread Starter dburns

    (@dburns)

    11 years, 4 months ago

    Thank linux4me2. I will give it a go and get to you if it worked.

Viewing 2 replies - 1 through 2 (of 2 total)
  • The topic ‘"A description for this result is not available b/c of robot.txt" message’ is closed to new replies.

Tags