Problems with Caption HTML

I am having some issues where the html code for my image captions are being shown in the rss feed… See example at:

http://www.hpgftp.com/captions.png

You can see my feed at http://budurl.com/8jq4

Any ideas what I could have setup incorrectly? Need to modify to remove this html code from the posts rss?