WordPress.org

Ready to get started?Download WordPress

Forums

problom with robots.txt (2 posts)

  1. aidinshah
    Member
    Posted 2 years ago #

    hello,
    i have a problom with robots.txt in Google webmaster tools.i got "Syntax not understood" even make robots manually or with plugins.
    this is my robots :
    User-agent: *
    Disallow: /cgi-bin/
    Disallow: /wp-admin/
    Disallow: /wp-includes/
    Disallow: /wp-content/plugins/
    Disallow: /wp-content/cache/
    Disallow: /wp-content/themes/
    Disallow: /wp-login.php
    Disallow: /wp-register.php
    Disallow: /?page_id=34
    Disallow: /2011/07/21
    Disallow: /2011/07/raising-cash
    Disallow: /sample-page
    Disallow: /?author=1
    Disallow: /author/admin

  2. MickeyRoush
    Member
    Posted 2 years ago #

    Is the .txt file saved as ANSI or UFT-8 without BOM?

Topic Closed

This topic has been closed to new replies.

About this Topic