allowing users to change vote for upvotes only

currently experiencing some inconsistencies with the voting system, but the main issue is how do you allow users to “unvote” or remove their upvote after the button/link has been clicked?

http://wordpress.org/plugins/buddypress-links/