Categories and tags not remaining when changing from post to portfolio

The taxonomy term relationships are still intact, there just is no longer an interface to interact with them, because Pages don’t support categories and tags.

In order to do what you want, you’d need to associate those taxonomies with the pages post type, meaning they would be available to all Pages.