If you have FTP access, you should be able to delete the folder yourself. Otherwise, in the Plugins menu, you should be able to delete that plugin.
Why not just create a page or a post that your user can edit with the ul in the content, and just display that on the sidebar?
