After a LOT of searching through complex .htaccess posts for the same answer, I found the exact procedure on this page (and it only took a few seconds).
http://www.idano.net/wordpress-feedburner-plugin-with-comments-45.htm
where they suggest adding ‘comments’, simply change to ‘category/categoryname’