Remove "PRIVATE: Page Name"

In your page edit dialog, just send it to the trash (if you want to get rid of the page). The PRIVATE page only shows up to those who are logged in.