Plug install crashes my admin area

why is it when I go to the back end of my wordpress site and install a plugin then I log out and try to log back it it takes me to the home page of the site and not the wp-admin. But if I delete the plug in not just turn it off but delete it, it all goes back to normal. So after I delete it I log out then log back in and it takes me right to the wp-admin