Line 331 in wp-includes/comment-functions.php is
echo ' title="' . sprintf( __('Comment on %s'), $post->post_title ) .'">';
If there is a post title with quotes, they are not escaped and makes the page XHTML invalid.
Maybe there should be a fix for this in a future version?