Post by Email

I have set up my blog to allow me to post by email by sending the post to a specific email. It works automatically from my Gmail address but if I send it from any other email address the post on the Admin interface but is labeled “pending” instead of automatically being published. I would like it so that any post emailed to the blog be automatically published instead of labeled pending, is there any way to do this?

What have I tried:
1) Even emails from registered users with contributor/author access get labeled as pending
2) Made sure the iframe code is in the right section of the footer.php