Despite everything I've tried, comments do not cause super-cached pages to update. As a logged-in user, I can see the new pages, so legacy cache is fine, but if I go in with a different browser as an unrecognized user, I see an old page without the comments. For hours and hours and hours. I've had users tell me that they have the same problem, including at least one commentator who should be a recognized user, but is using firefox on linux. [Further correspondence disclosed he deletes all his cookies, so I presume he's treated as a non-recognized user.]
I have this same problem whether I use mod_rewrite or the PHP version (with the rewrite .htaccess code manually deleted).
The one oddity about my site is that it is actually located at [url]/site rather than at just [url]. This is not visible to the user, as I use the redirection plugin (http://urbangiraffe.com/plugins/redirection/). I am also hosted at Dreamhost on a VPS, but not using the "tmp" hack recommended on an earlier support thread. (I wasn't able to follow the documentation -- would I need to change the .htaccess code too?). [Update: since first posting I've changed the cache files location to a director under /tmp, and started using the PHP version so there's no .htaccess code to change. This hasn't really changed anything as I still have the comment problem, and the site still goes nuts and uses wild amounts of memory every couple of days.]
Although I've played around with a lot of options, my current settings are:
* Use PHP
* Compress pages
* 304 Not modified
* Cache rebuild [But note that my comment problem persists for over a day at a time]
* Moible device suppport [and comments on the mobile version work fine, as I've listed many many mobile user types as 'Rejected User Agents']
* Extra homepage checks
* List newest cached files
Cache timeout 7200 seconds
Scheduler timer 600 seconds
Do not cache feeds
And a long list of rejected users agents for cell phones.
Under "Preload" I checked "preload mode". I have also tried unchecking it. I've tried various Refresh intervals from 720 up to 14400 minutes.
I have a large site, but most pages are old don't get comments, so I what I want is to create a large library of static files for them, and just have the pages update when a comment comes in -- which is not that frequent, and usually only on the more recent pages. But I do want the pages with comments to reflect them.
Daily traffic at discourse.net is in the 500-1000 range at present. [Maybe even less for the holidays.]
(Apologies if this is a duplicate posting; I think I posted the first version in the wrong place as it's not showing up on the list here.)
Some additional questions since the first post:
Is there a setting which controls the speed at which comments show up?
Why is it before I changed the debug file address to /tmp when I would visit the site as an anonymous user with debug turned on, if pages are served with supercache it sometimes produced no info in the debug file? [Note also that having changed the location to /tmp breaks debug because the debug data file is stored in the new dire rectory location, but that location is one I can reach via http.]
Final note: If you visit discourse.net you will see most of the comments, because I've been deleting the cache manually from time to time; fortunately commenting is very slow during the holidays.