Support » Requests and Feedback » Ratings …

  • Resolved geoff11234

    (@geoff11234)


    The concept of reviews is good but my concern is the level of reliability. I know it is easy to apply bias by the number of reviews of a particular level. ‘1 star’ can influence against a particular plugin while ‘5 star’ can influence for a plugin. In one particular instance I counted 70% (21 ‘5 star’ entries out of 30 on the first page) and 96% ( 29 out of 30) on the second page, all from the same reviewer. I also counted nearly 60% ( 7 out of 12 ‘1 star’ reviews) from the same person! This applies quite a bias and makes one wonder what, if any, benefit the reviewer is gaining from the large number of reviews he/she posts, if they are trying to influence its popularity, or just being stupid. It leaves me with no real level of confidence in the plug-in. It also begs the question of whether there is a better way to apply reviews such that confidence in the review system is increased. For example, counting the number of unique reviewers as well as the absolute count. Maybe take into consideration the time period over which the reviews occurred. Any way just some thoughts from one who is new to WordPress and looking for quality plug-ins that improve my site.

    In this particular case, I got some input from another developer who had used the plugin and took that as my benchmark (good by the way) but it really devalues the underlying concept of quality tools.

    A follow-up note … the person referred to turns out to be a contributor to the plugin. On principal, should probably recuse himself from the review process.

    • This topic was modified 5 months, 2 weeks ago by geoff11234.
Viewing 4 replies - 1 through 4 (of 4 total)
  • Moderator Jan Dembowski

    (@jdembowski)

    Forum Moderator and Brute Squad

    Are you making a suggestion for something or are you writing a blog post/discussion post? I’ve read your post and there’s not really any feedback here just an essay about ratings.

    *Drinks coffee*

    You’re missing something important that is lost in the word “Reviews” here. Reviews here are feedback and that includes the star rating. Nothing more and nothing less.

    This place is not LetterBay, it’s not Greek Sounding Online Mega Former Bookstore. No one needs to get a “good” review rating. And anyone trying to use the reviews here as anything but user feedback such as for marketing is making a Titanic level mistake.

    Yes, some reviews are less valuable than others. The 5 star review that says “The Best! 5 stars” is not as useful as the 500 word review 4 or 3 star that explains what the plugin or theme did on the reviewers installation. The 500 word review that points out what the user liked, did not like and what can be improved. Those reviews do happen as you know.

    That does not invalidate short 1 star reviews. Those are feedback too and if the plugin/theme author chooses to reply then they should consider doing so well. That’s the best thing they can do and that reply helps other users gauge if they want to use that plugin or theme too.

    Moderator Jan Dembowski

    (@jdembowski)

    Forum Moderator and Brute Squad

    A follow-up note … the person referred to turns out to be a contributor to the plugin. On principal, should probably recuse himself from the review process.

    I missed replying to that part. For plugins it’s easy. When someone is a plugin author, contributor or support for that plugin then they get an orange indicator with their post. Much like mine says “Moderator” on this reply.

    While I think it’s odd when they do review their own work it’s allowed and there’s nothing wrong with that.

    When someone creates new accounts or does not disclose that they are part of that plugin or theme then that gets caught and those reviews get removed. When it’s demonstrably shown that they were gaming the reviews and being dishonest (it happens) then those plugins and themes risk being removed and banned from this site.

    Thanks for your opinion Jan. Please humor me for a moment… Feedback in Communication or Meaning of Feedback: When a receiver answers or responds to the sender through a message or information it is called feedback. In other words, feedback is the reaction to the sender’s message. Review: To review means to look back over something for evaluation or memory. … The review of a thing often evaluates the work in question based on its strong and weak points. When I see a support page offering feedback, that is what I am doing. I am giving you my opinion of what I see, and mine was aimed at not being able to use the Review mechanism to assist in deciding if a plugin was as good as it claimed. In a general sense a ‘5 star’ review is generally assumed to be a highly recommended product while ‘1 star’ is the opposite. I assume the purpose of the star rating system is to promote superior products but, in my opinion, if the ratings can be biased by the author simply posting more good reviews, then it reduces the value of the review process. As for orange indicators, I could not see any nor could I see anywhere that advised of such. I am not interested in entering into further discussion, I am done. I respect your right to a different opinion than mine. My point was simply that the star system (which implies a good to bad rating) does not work when one can increase the rating by spamming and therefore did not help me in choosing a plugin. Please don’t waste any more time responding as I do not wish to spend more time on this subject. Thank you for your interest.

    Moderator Jan Dembowski

    (@jdembowski)

    Forum Moderator and Brute Squad

    Well, OK. I hope you have a nice day and leave more productive reviews.

Viewing 4 replies - 1 through 4 (of 4 total)
  • You must be logged in to reply to this topic.