OK this is weird.
However, most of the time, I get the error "An error has occurred; the feed is probably down. Try again later."
Most of the time. Not all the time. Sometimes it works fine.
The thing is, on a test-install of WordPress I have at another domain, the RSS plugin works fine. All the time.