I am getting the following html comment being inserted in the headers before content is sent from the server. (So as part of the HTTP headers)
<!-- Page not cached by WP Super Cache. No closing HTML tag. Check your theme. -->
This of course makes the headers look like they are part of the content, and I end up with a whole HTTP1.1 set of headers above the content. It appears to only happen on login (so wp-login) and initial view of the dashboard.
Tim