Support » How-To and Troubleshooting » Robots.txt Blocking Site Description in Search

Robots.txt Blocking Site Description in Search

  • ltldziner


    Problem: When I do a search for my clients company name, Musheno Woodworking Company on Google or Bing I get this:

    A description for this result is not available because of this site’s robots.txt – learn more.

    We would like to show you a description here but the site won’t allow us.

    Background: Before launch, I developed my clients WordPress site on a subdomain of their website. I used a plugin to make it private requiring login on the subdomain (just during dev) and I turned OFF search engine visibility in the WordPress Settings > Reading. I believe THIS last part is the root of the problem and what is still causing my issue.

    Things I’ve Already Tried to Solve This:
    1. In WP General Settings: enabled search engine visibility
    2. Rewritten/uploaded to root a new robots.txt:
    User-agent: *
    Disallow: /wp-admin/
    Disallow: /wp-includes/
    Disallow: /cgi-bin/
    3. In Google Webmaster tools, I verified its my domain and did the following:
    –URL submitted to be indexed
    –(all pages) indexed
    –I fetched as Google

    I’m seeing no change in the search result–it still points to the robots.txt as the problem. I’ve tried different variations of Step 2 & 3 about 8 separate times in the last 3 days. Surely its been re-crawled by now? Anyone have any thoughts on how I can resolve this?

  • The topic ‘Robots.txt Blocking Site Description in Search’ is closed to new replies.