Plugin Author
Allen
(@amweiss98)
this is not an error but a warning..it is saying that it’s trying to get an image from aol’s cdn server, and the connection to that server is timing out (probably due to a problem at aol or something that is blocking your server from reaching aol’s server).
I realize this fact. How long should this process take? If the resource is unavailable, shouldn’t it move on to the next quickly and finish it’s work? In my case, it seems to stall for 10-15 minutes on each feed item causing one cycle to last hours.
In the end, the database connection goes away as timed out due to the long time waiting for Multi Importer to finish it’s work. I have MySql set to time out transactions in 11 minutes. The result is that no new articles are posted.
WordPress database error MySQL server has gone away for query SELECT option_value FROM articles_options WHERE option_name = ‘_transient_doing_cron’ LIMIT 1 made by _get_cron_lock, W3_Db->query, W3_DbCache->query, W3_DbCallUnderlying->query, W3_Db->query, W3_DbProcessor->query, W3_Db->default_query
On a separate thought, would it not be prudent to download all feeds into a temp file first and then process each article individually from that temp file rather than using RAM to hold all downloaded data for processing? It would seem to be a more efficient use of resources for large feed profiles.
Plugin Author
Allen
(@amweiss98)
right now, if you are using shortcode, there are no images begin downloaded at all….there are only images (temp) when using the feed to post and setting the images as Featured Images…are you using the featured image setting?
http://bd.summit.net/articles/
I’m not using shortcode. I use, as have always, Excerpt and Featured Image setting.
I have over 100 feed sources.
I will say, my viewers have more than doubled within the last 24 hours while not posting new articles given the ram available to serve pages. It has increased due to the ram required to store and hold the large downloaded data for processing new articles on my limited resource server. This is the reason for my suggestion to download all RSS posts into a temp file and then process them as individual MySQL transactions.
Plugin Author
Allen
(@amweiss98)
the rss feeds, then, are simply made into blog posts using a cron scheduler and inputted into your mysql database in the exact same way any blog post is created on wordpress..the only other thing that happens now that is done my plugin is that in order to get the image into a featured image, it has to first be downloaded into a temp image and then uploaded into your media library – all using the standard wordpress protocols.
I’m not sure how this is different than what you are asking.
Do you use curl to download RSS feeds? No matter, that information has to be stored either in RAM or to a temp file. After all RSS feed information, from all sources have been downloaded, then they are processed. Am I correct?
In addition, a fact you did not address, how long is your “timeout” if images are unavailable. Shouldn’t it simply know an image is not available and move to the next post rather than wait?
Allen, after 3 days that RSS Multi Importer did not function to pull new posts and without any changes to the server or other factors, new posts simply began posting again without fail.
I can only feel that there may have been one feed source that may have had a corrupt or incorrectly constructed RSS feed that caused this plugin to not function correctly. After those posts had been replaced with new, I feel that the feeds once again were able to be processed. I wish we had been able to find this problem in order to assist you in making better an almost perfect plugin.
I certainly always appreciate your great efforts.
Plugin Author
Allen
(@amweiss98)
thanks…yes, the plugin works with RSS feeds, but relies on simplepie (something that is hooked into wordpress to read the feeds)…if the feed is corrupt, etc, there is nothing my plugin can do about it.
Thank you Allen. WordPress is only a compilation of php functions. Do you feel that you may be able to replace some of those functions, that have not been refined completely, with your own to better serve your great plugin?
Plugin Author
Allen
(@amweiss98)
I would have to rewrite the entire plugin in curl (then hope that users have curl on the server)…I’m not likely to do this until I get a large block of time (which I never have).
