WordPress.org

Ready to get started?Download WordPress

Forums

How to delete virtual Robots.txt file? (2 posts)

  1. natasa.mandic
    Member
    Posted 6 months ago #

    Hello everybody,
    I'm having issues with the virtual robots file that blocks my site. I've searched in blogs for solutions but couldn't find one that works. Lots of solution suggested were for older version of wp, the only thing I've changed in settings is to uncheck this option ->"Discourage search engines from indexing this site". But when I search for the domain in google i get this message "A description for this result is not available because of this site's robots.txt" and in webmaster tools when I try to submit the sitemap it gives me this error "URL restricted by robots.txt".
    I've tried to create a new robots file to overwrite the virtual one and this is what it comes out http://happygreenfood.com/robots.txt

    What should I do to solve this problem? I don't need and don't want a robots file.

  2. Pioneer Valley Web Design
    Member
    Posted 6 months ago #

    Works like this: Create one and add it to your site root. If one exists, WP will not use the virtual one. Also, let Google scrape your site again (and again and again). You need to give them time to index your site. Also use Google Webmaster Tools to submit both your robots.txt file and a sitemap. Many SEO plugins can do this also.

Reply

You must log in to post.

About this Topic