One quick way to speed it up a good bit is to comment out the ENTIRE innards of the function "wpautop" in /wp-includes/formatting.php. It contains about 20 regular expression (regex) matching/replacing calls, each on potentially the entire post content for e.g. each post on the blog index page.
Regex is resource intensive, and this can be 200 such calls for someone that has e.g. 10 posts showing.
Here is the line in default-filters.php that does this call: add_filter('the_content', 'wpautop');
1) It's really not necessary to filter what amounts to a syntax check EVERY TIME the post gets displayed. If anything, call it on update... if you must...
2) In general, I have found 0 adverse effects from cutting out this big-brotherly rummaging through the HTML (and there are a few unintended errors in there where some of the "greedy operators" run amuck and replace valid div tags with p tags, stripping put valid embeds on etc. when using the post editors, which is what first alerted me to this function).
Everything seems to work faster and better...
If people use the editor, they can't really screw up the HTML compliance to badly anyway, if they use hand-coded inserts, etc. just let them be... if they screw things up, that's their problem... and they'll likely know right away anyway...