WordPress.org

1. robos85
   Member
   Posted 3 years ago #
   

   In google webmaster tools I can see that Google try to index sites like this: my-domain.com/some-article/wp-login.php

   How can I prevent Google to index that links. It's off course error 404.
   Should I make some robots.txt file? If yes what should be in it?

2. ryans149
   Member
   Posted 3 years ago #
   

   http://www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449

3. robos85
   Member
   Posted 3 years ago #
   

   I know that, but what rule should I put there?

4. robos85
   Member
   Posted 3 years ago #
   

   User-agent: *
   Disallow: /cgi-bin
   Disallow: /wp-admin
   Disallow: /wp-includes
   Disallow: /wp-content/plugins
   Disallow: /wp-content/cache
   Disallow: /wp-content/themes
   Disallow: /trackback
   Disallow: /feed
   Disallow: */trackback
   Disallow: */feed
   Disallow: /wp-login.php
   Disallow: /*wp-login.php$
   Allow: /

   Is that correct?

5. romanczar
   Member
   Posted 2 years ago #
   

   Did you find the perfect robots.txt file settings?

Topic Closed

This topic has been closed to new replies.