robots.txt
-
I have been having a problem with googlebot not being able to crawl my site properly foryourtable.co.uk – it seems the problem is my robots.txt
Using http://www.foryourtable.co.uk/robots.txt I was coming up against a 404 page so though the best thing was to clean that up so installed and ran >>TentBlogger 404 Repair
Seems like that was not the best thing to do as I now can’t see http://www.foryourtable.co.uk/robots.txt – just goes to home page.
My brain is getting a little frazzled as my technical ability has pretty much been reached.
I do know that there is no robots.txt in my root directory
? any ideas
Viewing 2 replies - 1 through 2 (of 2 total)
Viewing 2 replies - 1 through 2 (of 2 total)
- The topic ‘robots.txt’ is closed to new replies.