I just realized that the field containing the invalid characters is the <itunes:summary> field, which is being generated by the Podcasting plugin. The basic RSS feed generated by WordPress is valid. Since this appears to be an issue with that plugin, I will take my question to a more appropriate forum.
Thank you!
Ah, nevermind. Either the reinstall or replacing the wp-admin folder did fix the issue. I noticed chrome had cached the page when I opened it in IE and FF and it was fine.
I have the same issue. The screenshot posted matches my Dashboard problem exactly. I also tried disabling all plugins, and re-installing WordPress 3.3.1 from the dashboard. I also followed the advice from this thread and deleted the wp-admin folder, and uploaded a new copy. This has not resolved the problem.
Any ideas?