This plugin allow your user to quit your blog and delete his own account.
WordPress can allow your user to register by himself, but has no function to self delete.
You can also create Resign Page which displays message to your customer.
"Are you sure to delete your account? We miss you."
NOTICE: Requires PHP 5.3 and over.