What's the icon of the conversation? Is it an arrow?

There's a problem where sometimes a call is showed in the conversations application but it's not really a conversation.
If this is the problem you'll have a call from/to the same contact in the Phone application, delete it from the Phone application and I think it will be deleted from the Conversations application too.