It seems that a great deal of comment spam comes from robots that seem to be hitting the wp-comments.php file without ever going to the site itself.
I think it would be good to add nonces to the submission process so that you would have to actually submit from the comment form. This should eliminate the robotic spam.