Sorry to bump a month old thread, but I am having the exact same issue and has been happening for about 3-4 weeks (just thought we were getting spam account attempts until recently).
Anything to hunt down or try?
We removed the Twenty-Ten theme, but I will add in a basic theme and troubleshoot that path.
Is there an error log or something along those lines to aid in troubleshooting?