I finally hunted down that it is your plugin loading farbtastic on my website for all visitors. If you only need this on the admin why are you loading it on all the pages of the website?
It does not even look like you are using it on the admin section of this plugin. I don't see the color picker opening anywhere.
I like the plugin but loading extra css and scripts for all visitors when you only need them in the admin is poor coding IMHO.