404 errors/googlebot cannot access
-
Not sure whats going on..
I am going through logs and seeing tons of 404 errors, but when I go to the page its accessible.
On webmaster tools i get crawl errors and googlebot cannot access; “Before we crawled the pages of your site, we tried to check your robots.txt file to ensure we didn’t crawl any pages that you had roboted out. However, we received a 5xx (unreachable) error when we tried to retrieve your robots.txt file. To make sure we didn’t crawl any pages listed in that file, we postponed our crawl.”
Yeah, I don’t know what to do.
The topic ‘404 errors/googlebot cannot access’ is closed to new replies.
