If you have e-mail notification turned on, check the e-mail address used to notify you when someone posts a comment (it’s under Settings – General).
Somehow mine had gotten truncated when I changed some general settings – probably through an auto-fill in. After fixing the e-mail address, people were able to comment again with out getting the 500 server configuration error.