The live preview plugin leaves an open div tag. Even if this line says
echo $before.'<div id="commentPreview"></div>'.$after;
It shows in Chrome resource inspector as: <div id="commentPreview">
I found this after installing Subscribe to comments plugin and the checkbox of this one was thrown away from the comments form because of this open tag, after which the other plugin code was inserted.