Cron does not update pipes

  • Resolved helices

    (@helices)


    9 years, 8 months ago

    For a month now, the cron job runs, but does NOT update my pipes. This used to work, now it does not.

    I had this problem about one year ago, posted here to no avail, and after about one month, it simply began working again.

    Yes, the “test” buttons work and do update my pipes.

    Yes, cron is working. How do I know? Because the following is the script I’m calling from cron:

    /bin/echo "START:date`” >>$HOME/public_html/callio.log
    /usr/bin/curl -o /dev/null -s ‘http://sub.mdsresource.net/?pipes=cron&task=callaio’ 2>>$HOME/public_html/callio.log
    ### /usr/bin/lynx -dump ‘http://sub.mdsresource.net/?pipes=cron&task=callaio’
    ### /usr/bin/wget -O /dev/null ‘http://sub.mdsresource.net/?pipes=cron&task=callaio’
    /bin/echo “STOP: date” >>$HOME/public_html/callio.log
    exit`

    Following is recent output logged to callio.log:

    START: Mon Aug 29 01:19:01 MST 2016
    STOP: Mon Aug 29 01:19:40 MST 2016
    START: Mon Aug 29 04:19:01 MST 2016
    STOP: Mon Aug 29 04:19:40 MST 2016
    START: Mon Aug 29 07:19:01 MST 2016
    STOP: Mon Aug 29 07:19:40 MST 2016
    START: Mon Aug 29 10:19:01 MST 2016
    STOP: Mon Aug 29 10:19:41 MST 2016
    START: Mon Aug 29 13:19:01 MST 2016
    STOP: Mon Aug 29 13:19:40 MST 2016
    START: Mon Aug 29 16:19:01 MST 2016
    STOP: Mon Aug 29 16:19:40 MST 2016
    START: Mon Aug 29 19:19:01 MST 2016
    STOP: Mon Aug 29 19:19:40 MST 2016
    START: Mon Aug 29 22:19:01 MST 2016
    STOP: Mon Aug 29 22:19:40 MST 2016
    START: Tue Aug 30 01:19:02 MST 2016
    STOP: Tue Aug 30 01:19:41 MST 2016
    START: Tue Aug 30 04:19:01 MST 2016
    STOP: Tue Aug 30 04:19:40 MST 2016
    START: Tue Aug 30 07:19:01 MST 2016
    STOP: Tue Aug 30 07:19:40 MST 2016
    START: Tue Aug 30 10:19:01 MST 2016
    STOP: Tue Aug 30 10:19:40 MST 2016
    START: Tue Aug 30 13:19:01 MST 2016
    STOP: Tue Aug 30 13:19:40 MST 2016
    START: Tue Aug 30 16:19:01 MST 2016
    STOP: Tue Aug 30 16:19:40 MST 2016
    START: Tue Aug 30 19:19:01 MST 2016
    STOP: Tue Aug 30 19:19:39 MST 2016
    START: Tue Aug 30 22:19:01 MST 2016
    STOP: Tue Aug 30 22:19:39 MST 2016
    START: Wed Aug 31 01:19:01 MST 2016
    STOP: Wed Aug 31 01:19:40 MST 2016
    START: Wed Aug 31 04:19:01 MST 2016
    STOP: Wed Aug 31 04:19:40 MST 2016

    As you can see, something is happening for >35 seconds each time it is called – but, ZERO pipes are updated.

    Please, advise. Thank you.

    ~ Mike

    https://wordpress.org/plugins/wp-pipes/

Viewing 15 replies - 1 through 15 (of 27 total)
1 2
  • LNN

    (@ewan-norman)

    9 years, 8 months ago

    Same problem with me. I can update pipes manually, automation doesn’t work script side or cron job.
    command I use: curl “http://latestnewsnetwork.com/?pipes=cron&task=callaio”

    The most recent log emailed from server:

    0 0 0 0 0 0 0 0 –:–:– 0:00:26 –:–:– 0
    0 0 0 0 0 0 0 0 –:–:– 0:00:27 –:–:– 0
    0 0 0 0 0 0 0 0 –:–:– 0:00:28 –:–:– 0
    0 0 0 0 0 0 0 0 –:–:– 0:00:29 –:–:– 0
    0 0 0 0 0 0 0 0 –:–:– 0:00:30 –:–:– 0
    0 0 0 0 0 0 0 0 –:–:– 0:00:31 –:–:– 0
    0 0 0 0 0 0 0 0 –:–:– 0:00:32 –:–:– 0
    0 0 0 0 0 0 0 0 –:–:– 0:00:33 –:–:– 0
    0 0 0 0 0 0 0 0 –:–:– 0:00:34 –:–:– 0
    0 0 0 0 0 0 0 0 –:–:– 0:00:35 –:–:– 0
    0 0 0 0 0 0 0 0 –:–:– 0:00:36 –:–:– 0
    0 0 0 0 0 0 0 0 –:–:– 0:00:37 –:–:– 0
    0 0 0 0 0 0 0 0 –:–:– 0:00:38 –:–:– 0
    0 0 0 0 0 0 0 0 –:–:– 0:00:39 –:–:– 0
    0 0 0 0 0 0 0 0 –:–:– 0:00:40 –:–:– 0
    0 0 0 0 0 0 0 0 –:–:– 0:00:41 –:–:– 0
    0 0 0 0 0 0 0 0 –:–:– 0:00:42 –:–:– 0
    0 0 0 0 0 0 0 0 –:–:– 0:00:43 –:–:– 0
    0 0 0 0 0 0 0 0 –:–:– 0:00:44 –:–:– 0
    0 0 0 0 0 0 0 0 –:–:– 0:00:45 –:–:– 0
    0 0 0 0 0 0 0 0 –:–:– 0:00:46 –:–:– 0
    0 0 0 0 0 0 0 0 –:–:– 0:00:47 –:–:– 0
    0 0 0 0 0 0 0 0 –:–:– 0:00:48 –:–:– 0
    0 0 0 0 0 0 0 0 –:–:– 0:00:49 –:–:– 0
    0 0 0 0 0 0 0 0 –:–:– 0:00:50 –:–:– 0
    0 0 0 0 0 0 0 0 –:–:– 0:00:51 –:–:– 0
    0 0 0 0 0 0 0 0 –:–:– 0:00:52 –:–:– 0
    0 0 0 0 0 0 0 0 –:–:– 0:00:53 –:–:– 0
    0 0 0 0 0 0 0 0 –:–:– 0:00:54 –:–:– 0
    0 0 0 0 0 0 0 0 –:–:– 0:00:55 –:–:– 0
    0 0 0 0 0 0 0 0 –:–:– 0:00:56 –:–:– 0
    0 0 0 0 0 0 0 0 –:–:– 0:00:57 –:–:– 0
    0 0 0 0 0 0 0 0 –:–:– 0:00:58 –:–:– 0
    0 0 0 0 0 0 0 0 –:–:– 0:00:59 –:–:– 0
    0 0 0 0 0 0 0 0 –:–:– 0:01:00 –:–:– 0
    0 0 0 0 0 0 0 0 –:–:– 0:01:01 –:–:– 0
    0 0 0 0 0 0 0 0 –:–:– 0:01:02 –:–:– 0
    0 0 0 0 0 0 0 0 –:–:– 0:01:03 –:–:– 0
    0 0 0 0 0 0 0 0 –:–:– 0:01:04 –:–:– 0
    0 0 0 0 0 0 0 0 –:–:– 0:01:05 –:–:– 0
    0 0 0 0 0 0 0 0 –:–:– 0:01:06 –:–:– 0
    0 0 0 0 0 0 0 0 –:–:– 0:01:07 –:–:– 0
    0 0 0 0 0 0 0 0 –:–:– 0:01:08 –:–:– 0
    0 0 0 0 0 0 0 0 –:–:– 0:01:09 –:–:– 0
    0 0 0 0 0 0 0 0 –:–:– 0:01:10 –:–:– 0
    0 0 0 0 0 0 0 0 –:–:– 0:01:11 –:–:– 0
    0 0 0 0 0 0 0 0 –:–:– 0:01:12 –:–:– 0
    0 0 0 0 0 0 0 0 –:–:– 0:01:13 –:–:– 0
    0 0 0 0 0 0 0 0 –:–:– 0:01:14 –:–:– 0
    0 0 0 0 0 0 0 0 –:–:– 0:01:15 –:–:– 0
    0 0 0 0 0 0 0 0 –:–:– 0:01:16 –:–:– 0
    0 0 0 0 0 0 0 0 –:–:– 0:01:17 –:–:– 0
    0 0 0 0 0 0 0 0 –:–:– 0:01:18 –:–:– 0
    0 0 0 0 0 0 0 0 –:–:– 0:01:19 –:–:– 0
    168 168 0 168 0 0 2 0 –:–:– 0:01:20 –:–:– 34
    168 168 0 168 0 0 2 0 –:–:– 0:01:20 –:–:– 43
    {ogb-res:0}
    <hr />2016-08-31 21:15:40 [ 1472678140 – Start ]
    0000-00-00 00:01:02 [ 0000000062 – Run  ]
    2016-08-31 21:16:42 [ 1472678202 – Stop ]

    Thanks for your help.

    Thread Starter helices

    (@helices)

    9 years, 8 months ago

    I increased:
    max_execution_time = 900

    Within an hour, the cron job worked and created one (1) new item

    That was nearly 24 hours ago.

    Since then, not one new item is created, unless I run my pipes manually (Test This Pipe)

    Please, advise. Thank you.

    Thread Starter helices

    (@helices)

    9 years, 8 months ago

    NOTE: I am NOT receiving any errors in any log file known to me

    Plugin Contributor Tung Pham

    (@phamtungpth)

    9 years, 8 months ago

    Hi all,

    Please all of you try this way: Delete all data within the Cache folder in YOUR_PATH_SITE/wp-content/uploads folder. Then keep following how the cronjob works.

    Best Regards!

    Thread Starter helices

    (@helices)

    9 years, 8 months ago

    Nothing there:

    helices@a2plcpnl0168 [~/public_html/wp-content/uploads/cache]$ ls -al
    total 12
    drwxr-xr-x 3 helices helices 4096 Feb 11 2016 ./
    drwxr-xr-x 8 helices helices 4096 Sep 1 05:38 ../
    drwxr-xr-x 9 helices helices 4096 Aug 1 10:15 wppipes/

    helices@a2plcpnl0168 [~/public_html/wp-content/uploads/cache]$ cd wppipes/
    helices@a2plcpnl0168 [~/public_html/wp-content/uploads/cache/wppipes]$ ls -al
    total 252
    drwxr-xr-x 9 helices helices 4096 Aug 1 10:15 ./
    drwxr-xr-x 3 helices helices 4096 Feb 11 2016 ../
    -rw-r–r– 1 helices helices 103 Aug 6 20:51 cronlog.info
    -rw-r–r– 1 helices helices 538 Aug 6 20:51 cronlogitem.info
    drwxr-xr-x 2 helices helices 4096 Feb 11 2016 data/
    -rw-r–r– 1 helices helices 1 Aug 6 20:51 done
    drwxr-xr-x 2 helices helices 12288 Aug 13 08:37 ecache/
    drwxr-xr-x 15 helices helices 4096 Aug 3 09:22 edata/
    drwxr-xr-x 2 helices helices 12288 Sep 4 17:11 ips/
    drwxr-xr-x 2 helices helices 167936 Aug 4 00:35 log/
    -rw-r–r– 1 helices helices 12323 Aug 6 18:58 plugins
    -rw-r–r– 1 helices helices 10 Sep 5 06:11 run
    drwxr-xr-x 2 helices helices 4096 Sep 5 06:29 saved/
    -rw-r–r– 1 helices helices 19 Sep 5 06:29 savedinfo
    drwxr-xr-x 10 helices helices 4096 Aug 31 19:19 urldata/

    helices@a2plcpnl0168 [~/public_html/wp-content/uploads/cache/wppipes]$ cd data/
    helices@a2plcpnl0168 [~/public_html/wp-content/uploads/cache/wppipes/data]$ ls -al
    total 12
    drwxr-xr-x 2 helices helices 4096 Feb 11 2016 ./
    drwxr-xr-x 9 helices helices 4096 Aug 1 10:15 ../
    -rw-r–r– 1 helices helices 9 Aug 4 00:35 runing.info

    Please, advise. Thank you.

    Thread Starter helices

    (@helices)

    9 years, 8 months ago

    FWIW, I have ten (10) pipes, each with an average ten (10) RSS Feed URL’s.

    Is this a system resource issue?

    If so, where?

    Again, I do not find any errors that I can correlate with the cron job.

    ~ Mike

    Thread Starter helices

    (@helices)

    9 years, 8 months ago

    Tung Pham,

    WHERE are these cache files you asked us to delete?

    Look at my listings above. Under which directory are the files you asked to delete?

    Please, advise. Thank you.

    ~ Mike

    [Moderator note: Please, no bumping.]

    Plugin Contributor Tung Pham

    (@phamtungpth)

    9 years, 7 months ago

    Hi helices,

    Did you look for the Cache folder in /public_html/wp-content/uploads as I suggested? If Yes, you could completely delete that Cache folder then follow how the cronjob works.

    Best Regards!

    • This reply was modified 9 years, 7 months ago by Tung Pham.
    Thread Starter helices

    (@helices)

    9 years, 7 months ago

    OK, I finally understood which directory to delete, and I did it.

    In fact, wp-pipes did recreate a new directory structure.

    A couple updates were received over the next 2 days.

    Then, for three (3) days – NOTHING.

    This morning, I deleted – again – that “cache” directory. Cron ran 15 minutes later, and ONE (1) update is received.

    I know, by looking at the feed, that there are AT LEAST 10 updates available.

    Please, advise. Thank you.

    Plugin Contributor Tung Pham

    (@phamtungpth)

    9 years, 7 months ago

    Hi helices,

    It seems your system has any limitation with storing data into that Cache folder. So if possible, please try to delete that folder frequently by somehow!

    Best Regards!

    Thread Starter helices

    (@helices)

    9 years, 7 months ago

    I doubt that is the problem.

    Even after deleting that cache directory, the next run seems to run only one or two of my eight (8) pipes. What’s that all about?

    Cron used to work properly on this host.

    Now, it never posts all of the rss feeds that I get by manually running each pipe.

    How can I know exactly which pipes are run and which feeds are found during each cron run?

    Please, advise. Thank you.

    Thread Starter helices

    (@helices)

    9 years, 7 months ago

    For example, I read your latest response, went to my host and deleted that cache directory again.

    (10) minutes later, the cron job ran, producing one (1) new post.

    I waited (10) minutes for the cron job to complete

    Then, I went to (1) of my (8) pipes, and clicked “Test in Update mode”

    Now, I have >30 new posts – from just that one pipe!

    What is that all about?

    Please, advise. Thank you.

    Thread Starter helices

    (@helices)

    9 years, 7 months ago

    Why does EVERY logfile under …/wp-content/uploads/wp-pipes/log/ have exactly TWO (2) URL’s – never more, never less

    What am I missing?

    Plugin Contributor Tung Pham

    (@phamtungpth)

    9 years, 7 months ago

    Hi Rolling Stone,

    Thank you very much for your wonderful effort!

    I agree with you that the cronjob feature of WPPipes should be improved more! We are trying to do that but because of the limitation of our resources, I do not know exactly when this work done. However I think your add-on is good choice for our users currently!

    Thank you again!

    Best Regards!

    Thread Starter helices

    (@helices)

    9 years, 7 months ago

    Tung Pham, is this to say that you do not support cron jobs, specifically for my problem where it hardly works at all?

    How can I call each pipe via CLI?

    ~ Mike

Viewing 15 replies - 1 through 15 (of 27 total)
1 2

The topic ‘Cron does not update pipes’ is closed to new replies.