Remove default retrieve_password action

I am attempting to modify the message emailed to a user from the retrieve_message function via a plugin, but the remove_action function does not seems to be stopping the default function as defined in wp-login.php. Is there a way to prevent the default retrieve_password from being called in order to customize the email being sent (w/o modifying wp-login.php for obvious reasons). Thanks!