I think this is because you are surrounding the testimonial with paragraph tags (or wordpress is adding them). Is there a workaround with css to get the quotes to inline with the testimonial.
This is what mine look like on the page:
quote is here.
newest version of wp 3.5, newest version of plugin 2.5.5