Have you tried setting flush to yes (or no) ?
Thread Starter
Seph
(@seph)
Yeah, that setting seems to do nothing. No difference.
Thread Starter
Seph
(@seph)
I think I might have an idea what is going on. If you clear the cache on the FTP it seems to work afterwards. It even works if its loading very long and gives back a internal server error – if you check afterwards the cache is build on FTP.
So the issue is that the plugin has problems when there already is a cache maybe? or when the cache data is old? I don’t know.
Thread Starter
Seph
(@seph)
NAh, forget it. It crawls pages when 500 internal server, but only partly. And after that it is back to 0 pages crawled. Also, every external cron job service I tried ultimately timed out. It barely works 80% of the time. No idea what is going on, I love the concept behind the plugin.
