We cannot know.
Did you have blogging by mail setup ?
If you did, remove it.
Where do I turn that off?
I think I went to the url /wp/wp-mail.php once, but I didn’t click anything there…. I just went to the URL
Under Options / Writing do you have details setup for your email account? If so delete your login details and save the page.
Ok thanks!
Now I just have to delete like 300 posts lol
What version of WordPress are you using? You really need to provide more details. As podz said, a link would be great too.
We can’t just magically help you without knowning anything about your site. 😉
For additional reading on this topic:
http://codex.wordpress.org/Blog_By_Email
Wild surprise.
Given the flaws in other systems that can be on servers, and the OP’s initial confusion about turning off a service you have to go out of your way to get going, I would be very interested to see the site.