I placed the RSS Widget into a dynamic sidebar, and then removed it. But the widget is persisting in the live site – cleared cache, tried on different browsers. (I used the widget drop and place of WordPress 3.5 and have removed the widget from that sidebar placement.)