Title: Robots.txt get Missing
Last modified: February 21, 2026

---

# Robots.txt get Missing

 *  Resolved [spanizhfly](https://wordpress.org/support/users/spanizhfly/)
 * (@spanizhfly)
 * [1 month, 3 weeks ago](https://wordpress.org/support/topic/robots-txt-get-missing/)
 * Hi guys,
 * My robots.txt file keeps disappearing, even though I have excluded it from caching.
   Whenever I purge the cache, it returns, but after a few minutes, it disappears
   again. Please advise.
 * Thank you.

Viewing 5 replies - 1 through 5 (of 5 total)

 *  Plugin Support [jbgupdraft](https://wordpress.org/support/users/jbgupdraft/)
 * (@jbgupdraft)
 * [1 month, 2 weeks ago](https://wordpress.org/support/topic/robots-txt-get-missing/#post-18830947)
 * Hi,
 * Thanks for reaching out! Can you confirm the version of WP-Optimize being used
   on the site?
 * Could you also let me know if your robots.txt file is being generated by a plugin
   or if it’s being manually created? I’d like to run some tests.
 * I’m also wondering if you could temporarily test with WP-Optimize deactivated
   to see if the problem still occurs?
 * Thank you!
 *  Thread Starter [spanizhfly](https://wordpress.org/support/users/spanizhfly/)
 * (@spanizhfly)
 * [1 month, 2 weeks ago](https://wordpress.org/support/topic/robots-txt-get-missing/#post-18831519)
 * Hi,
 * Thank you for your email.
 * I am using the latest version of WP-Optimize on my site. The robots.txt file 
   is generated by Yoast, I believe. Additionally, I am using the Redis Object Cache
   plugin.
 * After deactivating WP-Optimize, the robots.txt file appears as expected.
 * Please let me know if you need any further information.
 * Thanks
 *  Plugin Support [jbgupdraft](https://wordpress.org/support/users/jbgupdraft/)
 * (@jbgupdraft)
 * [1 month, 2 weeks ago](https://wordpress.org/support/topic/robots-txt-get-missing/#post-18832019)
 * Hi,
 * Thanks so much for testing that. I’ve set my site up in a similar method with
   Yoast and Redis but so far I haven’t been able to reproduce the issue. When the
   robots.txt stops working are you getting a 404 Not Found when trying to visit
   the robots.txt URL?
 * Could you try enabling the WP-Debug mode and Debug log and check for any errors
   when the robots.txt URL stops working? We might see some hints in there as to
   why the URL isn’t working after a while.
 * Thank you!
 *  Plugin Support [jbgupdraft](https://wordpress.org/support/users/jbgupdraft/)
 * (@jbgupdraft)
 * [1 month, 1 week ago](https://wordpress.org/support/topic/robots-txt-get-missing/#post-18838377)
 * Hi,
 * Just wanted to send a quick update. I’ve looked through the code and all WP-Optimize
   does is filter the robots.txt function for the dynamically generated robots.txt
   but there’s no function in our code that would cause the feature to stop working
   completely.
 * Were you able to find anything in the WordPress debug log?
 * Thank you!
 *  Plugin Support [vupdraft](https://wordpress.org/support/users/vupdraft/)
 * (@vupdraft)
 * [1 month, 1 week ago](https://wordpress.org/support/topic/robots-txt-get-missing/#post-18843870)
 * We have not heard from you in a while so I am closing this ticket.

Viewing 5 replies - 1 through 5 (of 5 total)

You must be [logged in](https://login.wordpress.org/?redirect_to=https%3A%2F%2Fwordpress.org%2Fsupport%2Ftopic%2Frobots-txt-get-missing%2F%3Foutput_format%3Dmd&locale=en_US)
to reply to this topic.

 * ![](https://ps.w.org/wp-optimize/assets/icon-256x256.png?rev=1552899)
 * [WP-Optimize – Cache, Compress images, Minify & Clean database to boost page speed & performance](https://wordpress.org/plugins/wp-optimize/)
 * [Frequently Asked Questions](https://wordpress.org/plugins/wp-optimize/#faq)
 * [Support Threads](https://wordpress.org/support/plugin/wp-optimize/)
 * [Active Topics](https://wordpress.org/support/plugin/wp-optimize/active/)
 * [Unresolved Topics](https://wordpress.org/support/plugin/wp-optimize/unresolved/)
 * [Reviews](https://wordpress.org/support/plugin/wp-optimize/reviews/)

 * 5 replies
 * 3 participants
 * Last reply from: [vupdraft](https://wordpress.org/support/users/vupdraft/)
 * Last activity: [1 month, 1 week ago](https://wordpress.org/support/topic/robots-txt-get-missing/#post-18843870)
 * Status: resolved