WordPress.org

Ready to get started?Download WordPress

Forums

WordPress generates strange links (4 posts)

  1. WPuser3
    Member
    Posted 2 years ago #

    In my Webmaster tools I often see strange 404 errors. For example - "
    tag/nvidia/contact-me/" or "tag/official/feed/" or "tag/guide/feed/www.twitter.com" - they don't even make sense.

  2. adpawl
    Member
    Posted 2 years ago #

    Use robots.txt file to disallow this links.

    eg.

    User-agent: *
    Allow: /
    Disallow: /wp-admin/
    Disallow: /wp-includes/
    Disallow: /tag/
  3. WPuser3
    Member
    Posted 2 years ago #

    What about this instead?

    Sitemap: http://www.example.com/sitemap.xml
    
    # Google Image
    User-agent: Googlebot-Image
    Disallow:
    Allow: /*
    
    # Google AdSense
    User-agent: Mediapartners-Google*
    Disallow:
    
    # digg mirror
    User-agent: duggmirror
    Disallow: /
    
    # global
    User-agent: *
    Disallow: /cgi-bin/
    Disallow: /wp-admin/
    Disallow: /wp-includes/
    Disallow: /wp-content/plugins/
    Disallow: /wp-content/cache/
    Disallow: /wp-content/themes/
    Disallow: /trackback/
    Disallow: /feed/
    Disallow: /comments/
    Disallow: /category/*/*
    Disallow: */trackback/
    Disallow: */feed/
    Disallow: */comments/
    Disallow: /*?
    Allow: /wp-content/uploads/
  4. adpawl
    Member
    Posted 2 years ago #

    Use

    Sitemap: http://www.example.com/sitemap.xml
    
    # Google Image
    User-agent: Googlebot-Image
    Disallow:
    Allow: /*
    
    # Google AdSense
    User-agent: Mediapartners-Google*
    Disallow:
    
    # digg mirror
    User-agent: duggmirror
    Disallow: /
    
    # global
    User-agent: *
    Disallow: /cgi-bin/
    Disallow: /wp-admin/
    Disallow: /wp-includes/
    Disallow: /wp-content/plugins/
    Disallow: /wp-content/cache/
    Disallow: /wp-content/themes/
    Disallow: /trackback/
    Disallow: /feed/
    Disallow: /tag/
    Disallow: /comments/
    Disallow: /category/*/*
    Disallow: */trackback/
    Disallow: */feed/
    Disallow: */comments/
    Disallow: /*?
    Allow: /wp-content/uploads/

Topic Closed

This topic has been closed to new replies.

About this Topic

Tags

No tags yet.