@askfred
Do you mind to share which plug-in?
I have the same problem, but WP-DB-Backup plugin works fine for backing up. So now I have to keep these two plugins, hope this problem can be fixed.
Never mind, the data tables have some wrong collations, that you should manually change to utf-8.
The author promised to change it soon.
Which file(s) should I add these lines?