The plugin suddenly stopped working after apx 2k posts. I've talked with the hosting to increase the memory limit from 128M to 256M. This solved it for awhile but after 200 posts it stopped again. I suspect that checking for duplicates is responsible for this. Could you include it as an optional feature?