https with non port 443

Hi all,

My WP using 3.5
And I am the server owner who can full management it, LAMP.

Okay, on my setting my HTTPS port using non 443, for example, I change it listening on Port 4444

Then the
http://www.wp.com/blog/wp-admin
It show me the login box ok, on http I can enter the user name and password then login etc no problems

But if I am using
https://www.wp.com:4444/blog/wp-admin
It show me a broke box (Still see the user name and password box), once enter my user name and password
It just back to
http://www.wp.com/blog/wp-login.php

And show me the login box again (Mean if I am using
https://www.wp.com:4444/blog/wp-admin) I can’t login to the back end.

Do I need open some PHP to edit?

Thank you.