Unable to delete chat conversation

I have a private chat conversation which will not delete. I can delete it, and it gets removed, but it then comes back again. This conversation seems to be a snapshot of a past conversation as it always goes back to that chat even though there have been more recent private chats with that user.

How can I delete this conversation?