Security/deletion

I’m having two problems with Vitamin. I’ve had some security issues with my site since installing Vitamin, especially on mobile browsers.

So I tried to delete, but deleting breaks my website and tells me files are missing.

I currently have it deactivated, but I’d like to either know that it’s secure and reinstall it, or be able to delete it safely.

http://wordpress.org/plugins/vitamin/