I have this issue with the order of P and Divs when I add an image. It seems to be mucking up the design. This is what some typical HTML looks like:
<p>
<div id="attachment_2045" class="wp-caption aligncenter" style="width: 500px"><img class="size-full wp-image-2045" title="new-sprite-google" src="http://www.malcolmcoles.co.uk/blog/wp-content/uploads/2009/04/new-sprite-google.png" alt="New google sprite (left); old google sprite (right)" width="490" height="191" />
<p class="wp-caption-text">New google sprite (left); old google sprite (right)</p>
</div>
</p>
(from http://www.malcolmcoles.co.uk/blog/new-google-sprite-july-2009/)
I thought divs weren't allowed in <p>s?
It's gone even odder on other pages:
<p>
<div id="attachment_1943" class="wp-caption aligncenter" style="width: 502px"><img class="size-full wp-image-1943" title="bbc-ashes-2005" src="http://malcolmcoles.co.uk/blog/wp-content/uploads/2009/04/bbc-ashes-2005.png" alt="Query deserves 4 years ago?" width="492" height="203" /><p class="wp-caption-text">Query deserves 4 years ago?
</p>
</div>
<br />
Update: It's taking it from the DMOZ entry according to the comment below. Odd behaviour ...
<div class="tweetmeme_button" style="float: right; margin-left: 10px;">
That one has got a whole chunk of text not in a <p> ... The bit beginning Update.
Anyone got any clues on what causes this?