You have to locate define('WPLANG', 'el'); in wp-config.php and change the langueage code. For example ‘el’ is the code for Greek.
I have excactly the same problem. I noticed that the administrators receive two mails. One in html and one in plain text. The difference between the two is the mail server used to send it.