Website I’m running is sunnyinkabul.com. I keep getting this “A description for this result is not available because of this site’s robots.txt – learn more.” message when I try to search the site via Google. How do I fix this?
I’ve verified the site through Google, using Google Analytics. That site tells me that most of the pages on my site are blocked from being crawled, and no such page is found when I try to click over from the findingmytribe.me in wordpress.com on the site re-direct. In other words, if I search for a page from that site, it redirects to the new site and domain, but the page can’t be found until I search for it in the new site.
- The topic ‘Pulling hair out over robots.txt’ is closed to new replies.