WordPress.org

Ready to get started?Download WordPress

Forums

ScrapeAZon
ScrapeAzon reviews sometimes disappear (9 posts)

  1. anartica
    Member
    Posted 2 years ago #

    Hi,

    I recently installed your plugin on a site I'm developing for a publisher:

    Half Full Publisher

    On their product page:

    http://www.halffullpublishing.com/products/gents-with-no-cents/ (click the tab for 'amazon reviews').

    I've noticed this before, but the last couple of days it seems to be getting a little worse - namely it will stop pulling in content. This will last for a few minutes to what might be a couple of hours, then it will re-appear again. I do all the usual things, check the configuration, try different browsers, clear the cache etc. None of these make it re-appear until I check in some time later. Sometime updating the page seems to make a difference - but since this is for a client, I need to be as steady as possible.

    Any idea what's going on? Is it the server, or perhaps something to do with Amazon?

    Otherwise, plugin works great. The client's complaining so I have to check in on it.

    Best,

    Tim

    http://wordpress.org/extend/plugins/scrapeazon/

  2. jhanbackjr
    Member
    Plugin Author

    Posted 2 years ago #

    Hi, Tim.

    Thanks for using ScrapeAZon. I have not seen this behavior before, however I was able to reproduce it on your client's site. I suspect you might be experiencing some sort of caching issue. Here's why:

    1. The first time I loaded your client's page, I received an iframe URL that contained a date stamp of 2012-08-20 (look for the exp= parameter in the "scrapeazon-reviews" iframe src URL). If the date stamp in the URL is in the past at the time the URL is submitted to Amazon, Amazon will not return results to the iframe. They enforce the date/timestamp for several reasons laid out in the API terms of service.

    2. The second time I loaded your client's page, I received an iframe URL that contained an expiration date stamp of 2012-08-26 (tomorrow). Because the date/time stamp is in the future, Amazon returned content to the iframe.

    I'd recommend looking into the caching configuration on your client's site to ensure that the iframe URL ScrapeAZon produces is not being cached for an extended period of time.

    Hope that helps. Let me know how it goes and if I can be of any further assistance. And thanks again for using ScrapeAZon.

    james

  3. anartica
    Member
    Posted 2 years ago #

    HI James,

    Thanks for your speedy reply, very impressive. I don't know a lot about caching, but that seems to be it.

    I installed W3 Total Cache and recently configured it according to these instructions:

    http://www.doitwithwp.com/speed-up-wordpress-with-w3-total-cache/

    I did notice this happening once or twice even before I think I turned on the W3T plugin, however that well may have been a problem with my wireless service, which has been terrible of late.

    I wrote W3T as well, but any thoughts on how to configure, or should I try another caching plugin like WP Super Cache (I just found out W3T hasn't updated in a while, though an update is due out soon). I'm using your plugin on a couple more client sites and though performance is important, it's more important that these reviews appear consistently.

    Thanks for your help,

    Tim

  4. jhanbackjr
    Member
    Plugin Author

    Posted 2 years ago #

    Hi, Tim.

    No problem at all. Happy to help. I have successfully used ScrapeAZon and W3 Total Cache together in the past. On one site, I have the garbage collection interval for W3 Total Cache's "page cache" and "object cache" set to 3600 seconds (once per hour). That should mean that pages and objects get cached for no more than an hour at a time. Additionally, I have the "plugins" group configured as a "non-persistent" group in the object cache settings. I'm not certain on this, but I believe that means ScrapeAZon (and other plugin content) isn't cached at all. On my particular site, an hour's cache appears to provide good performance and not interfere with Amazon's expiration requirements.

    In your client's case, I would experiment with W3 Total Cache's garbage collection, expire intervals in both page and object caching to determine the optimal amount of time to retain a cached copy of a page in terms of both performance and Amazon's URL expiration requirements. You can find the garbage collection settings under the "Advanced" section of the "Page Cache" settings and "Object Cache" settings for that plugin. You could always choose to specifically exclude the "Gents With No Cents" page of your client's site from being cached using that same "Advanced" section of W3 Total Cache, but again that depends on how much of a performance hit would be acceptable on that page.

    Hope that helps! Let me know if I can be of further assistance.

    James

  5. anartica
    Member
    Posted 2 years ago #

    Hi James,

    Thanks a lot. these settings were already in place, except of course leaving out product page in question (do you put in the php template (ie single-product.php) or the url do you know?

    I'll see how it goes, if the problem persists, I might WP Super Cache. I'm sure W3TC is great, but they haven't updated in a year now, which is a kind of a long time. Maybe there's some clash there now.

    Thanks again,

    Tim

  6. jhanbackjr
    Member
    Plugin Author

    Posted 2 years ago #

    Hi, Tim.

    I believe you should be able to use the relative URL (without a preceding slash) in the "Never Cache These Pages" field.

    Let me know how it goes.

    James

  7. anartica
    Member
    Posted 2 years ago #

    James,

    Well, it's still happening, even after I disabled the browser cache entirely. Methinks there's some serious clash going on. We just had a big thunderstorm here (NYC) and everything's a bit wonky, but if it persists, I might disable w3TC entirely and see. Actually, I just disabled everything in w3tc and the amazon feed seems to be working fine so I guess that's what it was. I guess if the issue comes up for someone else, tell them to check their caching plugin.

    Thanks for all your help, very impressive. I'll have to try your 'goodreads' plugin as well.

    Tim

  8. jhanbackjr
    Member
    Plugin Author

    Posted 2 years ago #

    Hi, Tim.

    Thanks for the update. I'll keep an eye out. When I get some time, I might see if I can reproduce what's happening on your client's site in a development environment just to see if there is, indeed, a conflict.

    Thanks again for using ScrapeAZon.

    James

  9. anartica
    Member
    Posted 2 years ago #

    Hi James,

    thanks, I'd appreciate that. Keep me posted on what you find.

    Tim

Topic Closed

This topic has been closed to new replies.

About this Plugin

About this Topic