WordPress.org

Ready to get started?Download WordPress

Forums

[Plugin: Yet Another Related Posts Plugin] YARPP Performance (25 posts)

  1. exxonster
    Member
    Posted 5 years ago #

    Hi,

    I'm planning to use YARPP in a blog with > 15000 articles and growing - It's a planet-style blog, that's why there are so many posts.

    I wonder if YARPP will perform as good as a smaller blog in such a setup. Do you have any experience about it?

    Thanks,

  2. Hi @exxonster,

    Thanks for taking a look at YARPP and thanks for the great question. ^^ Two responses: (1) Yes, YARPP can work great with large blogs as its results are cached by caching systems (which you should use anyway!) like WP-Cache or SuperCache. (2) That being said, the algorithm itself has some room for optimization and I'm currently working on a new version which will rewrite the main query to be better optimized (no more joining of temporary tables, in case you're a mysql buff).

    mitcho

  3. cdrplum
    Member
    Posted 5 years ago #

    I have a blog has over 20k posts. When using YARPP, the page load is very very slow. usually every page load is under 2 seconds, when use this, the page load is near one minutes even more. so I disabled it.
    Hope the query method can be improved in the next release.

  4. Hi @cdrplum — I have a new version of the algorithm which should be dramatically faster and less memory-intensive... I would greatly appreciate it if you could beta it. Please email me and I will send you the beta.

    mitcho

  5. exxonster
    Member
    Posted 5 years ago #

    I'm also interested in testing the new code. My blog stopped responding after installing the plugin, so I disabled it. I'm emailing you my address.

    Thanks for your effort :)

  6. distobj
    Member
    Posted 5 years ago #

    I just tried the new 2.1 version, hoping it would help with the performance problems we had with 2.06. Alas, it brought the server to a crawl again.

    The site I tried it on has 5400 posts, about 200 categories, and a couple thousand tags (and uses WP Super Cache of course). It runs on a quad core Xeon with 4G of RAM, and CPU and which serves about a million hits per day, all while keeping CPU utilization hovering at about 5-10%. When I turn on YARRP, CPU goes immediately spikes to 90% and the site becomes unusable.

    Any suggestions for how we could optimize the query that YARRP performs? Perhaps additional indexes, turn types of matching off, etc..?

  7. @distobj - Thank you for trying out YARPP and letting me know about this issue. This is the second report I've heard of poor performance under 2.1, though that user installed it for the first time (I believe).

    What options are you using for your "relatedness"? Are you displaying on single pages? RSS? Is your traffic particularly RSS-heavy? Do you feel the performance is much worse than with 2.0.6? Are you using WP-SuperCache?

    I would like to help resolve this issue for you and for others very quickly. If you could email me I can build a debug version for you which may help identify this issue.

    Thanks again--

    mitcho

  8. distobj
    Member
    Posted 5 years ago #

    Hey. Thanks for the prompt response.

    I'll answer here in case my answers are useful to others.

    For "relatedness", we have everything selected with extra emphasis on the body content as well as "require at least one tag in common".

    I turned off RSS support only because I hadn't had a chance to see how it worked.

    Performance was "worse" than with 2.06 in the sense that 2.06 took about 15 minutes to bring the server to its knees (during almost peak traffic) whereas 2.1 brought it down almost immediately despite being tested during off-peak hours. That's not entirely an apples-to-apples comparison though, because I'd done lots of MySQL tweaking in the meantime.

    Yes, we're using WP-Supercache.

  9. michaelpark
    Member
    Posted 5 years ago #

    Even CommentLuv on other sites is failing to access my RSS feed with 2.1 and its RSS option turned off. I'm also using SuperCache.

  10. CyberCr33p
    Member
    Posted 5 years ago #

    I have performance issues too. The table is "locked" and the blog is unaccessible while it performs the query.

    Blog has 1000 posts, 70 categories and 5000 tags.

    The options I have are:

    Titles: consider
    Bodies: consider
    Tags: require at least one tag in common
    Categories: require at least one category in common

  11. Hi all,

    Thank you very much for your reports. It's disappointing to hear that the 2.1 queries are slower than 2.0.6 (even though I thought I had only made them faster) and hope to improve this situation quickly.

    I would like to know, if any of you could try this out, whether it's the tags + categories that slow things down so much or the fulltext title + body checks that are so slow. If any of you could try turning off title + body or turn off tags + categories and get any sense of the performance, I would appreciate that.

    I'm also curious about the RSS being slow, even if the RSS display is turned off... (@michaelpark) there is a quick check (get_option) which runs when an RSS feed item is constructed, but that should be a very quick transaction... are you seeing any YARPP output even though you chose to turn off the RSS auto display option?

    Thank you all in advance for your continued support and reports!

    mitcho

  12. michaelpark
    Member
    Posted 5 years ago #

    Regarding RSS, it acts as if it's not turned off even when it in fact is unchecked on its options page.

    I don't have other performance issues.

    Thanks.

    Mike

  13. @michaelpark - I see, so the RSS display is just being turned on, regardless of your setting... let me know if you're willing to try out a debug version which will help me understand why the RSS related posts are being displayed regardless of the option.

  14. michaelpark
    Member
    Posted 5 years ago #

    Sure, give me the link and tell me what to do.

  15. cdrplum
    Member
    Posted 5 years ago #

    //

  16. distobj
    Member
    Posted 5 years ago #

    I've just done a fair bit of testing, and when I enable tags & categories (at "consider"), I see the widest variance in CPU utilization by the mysql daemon. For bodies and titles, I'm seeing anywhere from about 0.6-1.1 sec, but for tags/categories, it can consume anywhere from 1 to 5 seconds depending upon the particular post I'm testing on.

  17. loomster
    Member
    Posted 5 years ago #

    Hi, I'm also experiencing the same performance issues with the 2.1 related version mentioned above. I am not using RSS. I have 25,000+ posts on a dedicated server. This plugin caused MySQL to go to 100% and then the server crashed. I eventually turned it off which is a shame cause I LOVE this plugin. If only it was faster..!

    The admin folks at the hosting company said there were a lot of write to tmp table. In fact the plug-in does not appears to be using indexes but is reading the whole table. I'm going to try turning off certain options within the plugin to see if that helps. Here is part of the offending code:

    Copying to tmp table | SELECT ID, post_title, post_date, post_content,
    (MATCH (post_content) AGAINST ('que de en usted con

  18. @loomster - YARPP does indeed use indexes in its joins--MySQL doesn't require explicitly listing the indexes. For example, the MATCH command can only be used because YARPP set up a fulltext index on the post_title and post_content columns of wp_posts...

    I would recommend following @distobj's advice and using only bodies and titles and not tags/categories in your "relatedness". That may help with performance. Turning off any "disallow" categories or tags will also help.

    In the future I'll be rewriting YARPP to use a new caching system... but in the mean time, that's what I recommend.

    Let me know how that goes for you.

    mitcho

  19. loomster
    Member
    Posted 5 years ago #

    Mitcho, Thanks for your advice and support.

    The good news is @distobj's advice appears to be working which is a relief as I'd like to keep using this excellent plugin. I look forward to new version of YARRPP where hopefully tag and category options can be reactivated.

    BTW, a much more minor issue the load speed of the admin page when large number of tags are involved. Since I have many thousands of tags it take about 30+ second for the admin page to load. This is a minor inconvenience but something to consider in your next release perhaps.

  20. @loomster - I'm glad that works for you, and I look forward to building that caching system in the near future so you can go back to leveraging your tags and categories.

    As for the tags in the options page... Hmm... that's an interesting issue to consider for large blogs. There are more pressing issues for the next point release, but I'll definitely keep that in mind for the future. Thanks for the feedback.

    mitcho

  21. consultingjunkie
    Member
    Posted 5 years ago #

    Hi, great plugin, I really appreciate all the work that went into it. I have the following error message at the top of my posts, I was reinstalling the plugin I think that's when it happened.

    WordPress database error: [Table'consultingwebsite_wrdp1.wp_yarpp_keyword_cache' doesn't exist]
    select count(*) as count from wp_yarpp_keyword_cache where ID = 303 and date > date_sub(now(),interval 400 minute)

    Any suggestions to fix it?

    Thanks a lot!

  22. @consultingjunkie - this is a bug in 2.1.2 which I'll be fixing in the next day or so. I've already corrected the development version, so feel free to use that in the mean time.

  23. OzPoker
    Member
    Posted 5 years ago #

    Just to add to this - I've had 2.1.3 installed and it brought the whole site to its knees and had to disable it which is a shame because i realy like it

  24. @OzPoker--I already responded to you here.

  25. Daddydesign
    Member
    Posted 4 years ago #

    hi, I’m looking for a plugin that’s just like this one but to grab related post from tons of other blog sites (not being my own). Is there something like this that exist?

Topic Closed

This topic has been closed to new replies.

About this Topic