• I’m having serious issues with my robots.txt file. I created a robots.txt file that I placed in the root folder, but something went seriously wrong as the robots.txt file was replaced with the default wordpress robots-file (the virtual one) but in the beginning there were 10 lines of gibberish makes the file unreadable. I installed a virtual-robots.txt plugin that seemed to override the gibberish with simple: User-agent: *
    Disallow: and now if you visit http://www.arksie.com/robots.txt you can see the correct robots file.

    However, Google still sees the file with the gibberish and if you test https://www.arksie.com/robots.txt on https://technicalseo.com/seo-tools/robots-txt/ the output is the gibbersih one, but if you press “see live robots.txt” it gives the correct one.

    The page I need help with: [log in to see the link]

Viewing 2 replies - 1 through 2 (of 2 total)
Viewing 2 replies - 1 through 2 (of 2 total)

The topic ‘Serious issues with robots.txt’ is closed to new replies.