It's me again. I saw that wordpress 3.4 brings the html support in image captions.
That's what I was looking for last week. Thanks WP !
So I tried display an image in an image caption to see it with Slideshow plugin. It works !
BUT, the image in the information bar replace the thumbnail picture.
If I'm not making myself clear, I will try to send you a screenshot.