http://codex.wordpress.org/Template_Tags#Comment_tags – try using the search feature for things… the codex will tell you almost everything you need to know…
I ended up figuring this one out after much experiementing, and I don’t see a reference for this in any of the documentation. On the page.php template, which is the default template when creating a page though it doesn’t have a title at the top, I simply inserted <?php comments_template(); ?>, which I stole from another template (I think archive). I believe I put it in the loop, but just to be clear it’s the last thing on the page right before the call for the side bar, and before </div>.
