Completely remove cache

Hi,

Thanks for the plugin and it works great. However, with some reasons, we have to terminate the usage of the cache plugin and I think that even the plugin deactivated, it still caching some config on WordPress. It will revoke the previous setting after save. I have to fix it by manually activate the plugin and flush cache and then deactivate the plugin again. So is there any permanent solution to completely erase all the cached record after installed / activated this plugin? Thanks.