Forums

Googlebot is indexing my plugins folder (2 posts)

  1. demstudio
    Member
    Posted 2 years ago #

    I must know why does google is indexing my plugins folder. So this cause errors 404. http://mydomain/wp-content/plugins/podpress/function.require

    Any ideas?

    Thanks

    Dem

  2. esmi
    Theme Diva & Mod
    Posted 2 years ago #

    Try adding a robots.txt file to the root directory of your domain. Google is pretty good at honouring the Disallow directive. I normally use something like:

    # robots.txt for http://domain.com/
    
    Sitemap: http://domain.com/sitemap.xml.gz
    
    User-agent: *
    Disallow: /css/
    Disallow: /cgi-bin/
    Disallow: /images/
    Disallow: /temp/
    Disallow: /wp-admin/
    Disallow: /wp-includes/
    Disallow: /themes/
    Disallow: /plugins/
    Disallow: /upgrade/
    Disallow: /uploads/

Topic Closed

This topic has been closed to new replies.

About this Topic