WP Web Scraper
Problem with cache not expiring (2 posts)

  1. Bill Dennen
    Posted 4 years ago #

    Hi, we've been using your plugin for many months, without any problems. However, with the most recent update, we have run into many instances where the cache is not expiring -- as a result, the scraping page is not updated, even though the original page has changed.

    I've set the cache timeout to various times (0, 1, 30 minutes). Nothing seems to help.

    For what it's worth, we upgraded from the old version of the plugin.

    Is there a way to nuke the cache manually? We'd like to do this if possible to see if this solves the problem.



  2. cgiliam
    Posted 4 years ago #

    I had the same problem for several months and couldn't find a solution online.
    Until there's a bugfix I've change the plugin-source a little bit.

    Edit the plugin under "Installed Plugins" and open the functions.php file.
    Lookup the function wpws_remote_request.

    Removed the last if-statement by adding // at the beginning:

    // if ( false === ( $cache = get_transient($transient) ) ) {

    Also mark the last else-statement as a comment:

    } else {
    $cache = get_transient($transient);
    $cache['headers']['source'] = 'Cache';
    return $cache;

    After these small changes it suddenly started working again.
    It doesn't matter anymore what your cache-setting is, since it's now ignored.

Topic Closed

This topic has been closed to new replies.

About this Plugin

  • WP Web Scraper
  • Frequently Asked Questions
  • Support Threads
  • Reviews

About this Topic