Support » Plugin: W3 Total Cache » [Plugin: W3 Total Cache] Can't Find robots.txt

Viewing 6 replies - 1 through 6 (of 6 total)
  • There is no setting to change this file and I’m unsure how it is related to this plugin. Anyway, to modify this file, please do the following…

    – Have a copy of what you see in your site’s robots.txt file
    – Create a new file named robots.txt file via FTP or ‘File Manager’ in the correct folder (probably in the folder where WordPress files reside)
    – Paste the previously copied text to robots.txt file
    – Do whatever you wish with the newly created file

    Huh, the plugin created the robot.txt file so it’s pretty related. I did create a new robot.txt file and added it to the main folder but it’s still showing the one W3 Total created, it’s not over-riding it.

    So does anyone know how to change the file within W3 Total, or how to access it?

    The reason why you are unable to access the actual file is because:

    – the real file is named something else but can be accessed as robots.txt through a rewrite rule
    – there is a file permission problem with your hosting provider

    You would have to check your .htaccess or nginx.conf for possible rewrite rules. However I am quite certain it is the latter which can only be resolved by your hosting provider.

    ahh ok, thanks I’ll look into that.

    Huh, the plugin created the robot.txt file so it’s pretty related.

    Please deactivate this plugin, create your own robots.txt file, try to access it from another browser. Please let us know what you see. If you still see the old robots.txt file, then there is no relation between robots.txt and this plugin.

    Also, it may help us, if you link your website’s URL.

    Plugin Author Frederick Townes


    Are you sure you don’t have another plugin that dynamically creates robots.txt?

Viewing 6 replies - 1 through 6 (of 6 total)
  • The topic ‘[Plugin: W3 Total Cache] Can't Find robots.txt’ is closed to new replies.