I've used Wp Ultimate CSV Importer Plugin for a few imports now, and it works very well under regular conditions.
However, if you turn on debugging (WP_DEBUG), this plugins spits out quite a few warnings and notices. You should get those fixed.
I also have a feature request:
You support meta fields, categories and tags well, but lack the support for custom taxonomies.
I'll definitly recommend this plugin. Thanks!