WordPress.org

Ready to get started?Download WordPress

Forums

WP & Google robots.txt file (1 post)

  1. saphruser
    Member
    Posted 6 years ago #

    hi i am using Google webmaster tool.can anyone pls help me interpret something pls?

    In diagnnostics>webcrawl under NOTFOUND I see http://saphruser.com/comments/feed - 404 (Not found) [?]

    and under URLs restricted by robots.txt (1)
    i see my main site url itself i.e http://saphruser.com/

    but whats contradicting is in Toos>Analyze robots.txt
    i see Status 200 (Success) [?] and
    User-agent: *
    Disallow:

    which means block nothing allow everything then why do i see ny site under URLs restricted by robots.txt?

    thsi explains why my site is not crawled by google.what do i do. i cant even find robots.txt file in public_html. its not there in the first place how is it blocking?

    did anyone have same problem pls rescue. thanks in advance.

Topic Closed

This topic has been closed to new replies.

About this Topic