Log 404 (file not found) errors on your site and get them delivered to you via e-mail or RSS.
No, this only works if you use pretty permalinks (/2006/01/01/post-name or similar). From what I can tell, the WordPress code doesn't flag URLs as 404s with ugly permalinks.
That about does it - enjoy!
--Alex King