Probably in header.php of your theme unless there is an option under Appearance.
If no menus are defined, then WordPress just takes all pages you have and puts that in for your menu. I believe you can define a menu, set it to the location you want, and just leave it blank, with no pages, and it should get rid of the menu links.
Thanks everyone. I understand the layout much more now. All set!