Huh, weird stuff... I have the same issue!
I got a wordpress site working on my local install, where I'm using my gmail address as the admin e-mail. English and French contact forms working perfectly as with all other elements of the site.
I export the pages from my site to the live hosted site (it's a local musician).
1) The contact forms work, but the e-mails are *still* going to my e-mail address (admin e-mail address of the local test site), weird.
2) I try adding the shortcode for specifying the e-mail explicitly ([contact-form email@example.com']), it has no effect. It is still sending the information to the admin e-mail on the source *test site*.
3) I suspect that it's because JetPack is connected to wordpress.com using my account, which has the same e-mail address. I update my wordpress.com to use my secondary e-mail address, this changes nothing, e-mails still going to the same (incorrect) e-mail address.
4) The Dashboard - Feedback shows all of the contact form responses, the wordpress admin e-mail address on the live hosted site is most definitely set to a different e-mail address.
Any thoughts? Great looking contact form by the way, I would hate to switch it to another plugin! The site is of a young prodigy here in Montreal, danielclarkebouchard.com (click on the 'Contact' menu in English, or 'Nous joindre' in French).
[contact-form][contact-field label='Name' type='name' required='1'/][contact-field label='Email' type='email' required='1'/][contact-field label='Website' type='url'/][contact-field label='Comment' type='textarea' required='1'/][/contact-form]