Can’t deactivate or delete plugin

I just uploaded and activated the plugin, but I decided not to use it. I’d like to delete it – but I can’t. When I try to deactivate it, a text box pops up saying that the plugin has been deactivated – but the plugin remains active. When I try to delete it, nothing happens.