WordPress.org

Ready to get started?Download WordPress

Forums

W3 Total Cache
[resolved] robots.txt not returned if W3TC active (8 posts)

  1. efikim
    Member
    Posted 3 years ago #

    Using development release of W3TC with page cache, minify and self hosted FTP CDN operational the wordpress generated robots.txt is not returned when its requested.
    If I just disable W3TC (using the 'Deselect this option to disable all caching functionality.' option on it general page) then it is generated. Re-enable W3TC and it isn't.

  2. efikim
    Member
    Posted 3 years ago #

    It is returned on a different site using the released version of W3TC rather than the development version, but no CDN (still WP 3.0)

    works: http://words.mikefinley.co.uk/robots.txt
    doesn't: http://blog.roguegenecollective.com/robots.txt

  3. efikim
    Member
    Posted 3 years ago #

    Found it!

    Its caused by the 'Do not process 404 errors for static objects with WordPress' which includes txt files amongst those it doesn't pass on to WordPress.

    If I edit the .htaccess and remove .txt from that list it works though W3TC is very protective of its changes and keeps wanting to putting it back!

  4. Tony Cecala
    Member
    Posted 3 years ago #

    Thanks for sharing what you learned!

  5. Frederick Townes
    Member
    Plugin Author

    Posted 3 years ago #

    This issue will be fixed in the next release.

  6. Frederick Townes
    Member
    Plugin Author

    Posted 3 years ago #

    I found a typo, but actually could not duplicate this issue @efikim. Can you submit a bug submission form from the support tab of the plugin so I can take a look?

  7. efikim
    Member
    Posted 3 years ago #

    I've 'fixed' it on my site by simply disabling 'do not process 404 errors'. That won't have had the very latest dev version applied - you already have access to it from another bug report if you want to look at exactly what is there.

    I'll be converting another site later this week, and will download the latest dev version of W3TC before hand - I'll check it out on that one and submit a bug for it if necessary.
    (I need to find time to do some work on the child theme I use there first)

  8. Frederick Townes
    Member
    Plugin Author

    Posted 3 years ago #

    Ok.

Topic Closed

This topic has been closed to new replies.

About this Plugin

About this Topic