Favicon is stuck

I installed a Https secure plugin, It wanted in the “host” blank a host, I mistakinly put DreamHost in there, and it changed my favicon to theirs, and locked me out of my site, I contacted them, and they were able to get me back on to my site, buy their favicon logo is still attached to me even though I have uninstalled the plugin completely.