Remove login page/just widget-sidebar

I am wondering if it is possible to get rid of the login page completely so I can just use the widget in a sidebar for logging in.
Right now when potential readers put in my url the first thing they see is this blank black login page – very unappealing. I would like my homepage to show with an option to login via sidebar.
Is this possible please?

https://wordpress.org/plugins/theme-my-login/