Forums

Googlebot is indexing my plugins folder (2 posts)

  1. demstudio
    Member
    Posted 4 months ago #

    I must know why does google is indexing my plugins folder. So this cause errors 404. http://mydomain/wp-content/plugins/podpress/function.require

    Any ideas?

    Thanks

    Dem

  2. esmi
    Member
    Posted 4 months ago #

    Try adding a robots.txt file to the root directory of your domain. Google is pretty good at honouring the Disallow directive. I normally use something like:

    # robots.txt for http://domain.com/
    
    Sitemap: http://domain.com/sitemap.xml.gz
    
    User-agent: *
    Disallow: /css/
    Disallow: /cgi-bin/
    Disallow: /images/
    Disallow: /temp/
    Disallow: /wp-admin/
    Disallow: /wp-includes/
    Disallow: /themes/
    Disallow: /plugins/
    Disallow: /upgrade/
    Disallow: /uploads/

Reply

You must log in to post.

About this Topic