Hi there. I have been using WP Super Cache for a while in "php mode" on a shared server (80,000 web pages), with compression disabled and about 6 hrs interval on cache deletion. I was unsatisfied about the overall performance and wanted to keep some dynamic content uncached. So I have uninstalled the plugin, however I admit that this is due to to a lack of proper settings balance. It takes time to tweak, and each case is different.
I finally could make it to work the dynamic content through jQuery and testing again the plugin, seems working.
Now I'm looking for advises about configuring properly the plugin at its best.
Basically I'm experiencing server load due to spiders. Multiple spiders on large number of pages. Little traffic by users, some 1,000 page views a day.
What settings would you use to begin with? Should I enable generation of static pages also for spiders?