Yes. If you're seeing that your Pages look just like your Posts, then chances are you don't have a Page template (page.php).
Most decent templates will have a template for Posts (single.php), and a template for Pages (page.php). They may give them various names, but those are the actual files, which you can see in Appearance... Edit.
So you can edit page.php, or if you don't have one, you'll have to make one. Or simply try a different theme. :)
WordPress themes are very alterable, but somewhat complex. More info here.
Good luck, D