No complication. This is the easiest and functional existing plugin

If you want speed you need a good plug-in to compress your code like Autoptimize.
Caching is another thing. You have to make static page made with an optimized code. So you don’t need of (unuseful) complications, you simply need a plugin like Cache Enabler. The best thing is that you can erase the cache of a single page, this is not possible with WP super cache, that is a good cache plugin too.