New Rating System Feedback

Talk Discussion in 'BeerAdvocate Talk' started by sd123, Dec 18, 2014.

Thread Status:
Not open for further replies.
  1. SoCalBeerIdiot

    SoCalBeerIdiot Pooh-Bah (2,191) Mar 10, 2013 California
    Pooh-Bah Trader

    At this point we're just quibbling. Not sure how the timeline is relevant. I get that the original system was closer to this than the previous iteration but I'm arguing for a more inclusive system, you're arguing for a more rigid system. That's it, timelines be damned.
     
    MLaVioletteJr likes this.
  2. Todd

    Todd Founder (13,518) Aug 23, 1996 Finland
    STAFF Mod Team Society Pooh-Bah

    I added it immediately after posting; recalling a reply to similar feedback from years ago. Anyway. It wasn't intended to be a slap in the face. I also welcome constructive feedback and the discussion, so long as it remains constructive.
     
    SoCalBeerIdiot likes this.
  3. geocool

    geocool Savant (1,233) Jun 21, 2006 Massachusetts

    Interesting. If the amount of "thought behind the numbers" doesn't significantly affect the numbers, then I'm not seeing the benefit of the change. Seems like all downside to me. Just my $0.02.
     
    Patches826 and iTunesUpdates like this.
  4. MLaVioletteJr

    MLaVioletteJr Initiate (0) Jun 12, 2013 Massachusetts

    It's not that it's too much work to rate all five attributes or to have to write a review every once in a while. It's the fact that now all attributes need to mean the same thing to all raters, no unique interpretations of style allowed...It's important for any beer to taste and smell great. But if it goes down like a raw egg then who cares what the BJCP guidelines say? Apparently I'm wrong. An arbitrary system based on another arbitrary system is still arbitrary.

    The bottom line for me is that everyone, regardless of style or preference is forced to treat all attributes with the same weight and that doesn't make sense.
     
  5. SoCalBeerIdiot

    SoCalBeerIdiot Pooh-Bah (2,191) Mar 10, 2013 California
    Pooh-Bah Trader

    For me, it is. That's all this is about for me (and for others who've already chimed in), but yeah, this change is going to be unpopular with lots of users for lots of different reasons. I'm willing to give it a shot, and maybe I'll even get used to it but even that won't change the fact that it'll still take 5x longer to rate beers (and I rate a lot of beers).
     
    Patches826 and iTunesUpdates like this.
  6. Patches826

    Patches826 Pooh-Bah (2,479) Aug 28, 2013 Massachusetts
    Society Pooh-Bah

    Wait. So appeasing industry friends is more important to you than alienating a chunk of users who have invested in your site? Man, at this point you might as well just come out and say "Too bad guys, have fun on Untapped". There has to be a simpler/better way to eliminate outlier scores and troll reviews than this. Good thing BA is free to use or I'd be fuming right now.
     
    kscaldef and iTunesUpdates like this.
  7. drtth

    drtth Initiate (0) Nov 25, 2007 Pennsylvania
    In Memoriam

    You left out feedback from users who don't/didn't like the quick and easy rating stuff that's been tried for a couple of years and now dropped in favor of a compromise that may work better for more people.
     
    PapaGoose03 and Todd like this.
  8. iTunesUpdates

    iTunesUpdates Initiate (0) May 7, 2014 Florida

    Null and void considering there are just as many users who did like it.
     
  9. drtth

    drtth Initiate (0) Nov 25, 2007 Pennsylvania
    In Memoriam

    Show me the data. Both the numbers of users who like, dislike, and don't care, along with the relative contributions to what makes the site a valuable resource for the community.
     
    #129 drtth, Dec 21, 2014
    Last edited: Dec 21, 2014
  10. markdrinksbeer

    markdrinksbeer Initiate (0) Nov 14, 2013 Massachusetts

    I am happy and surprised to see this implemented. I suggested something very similar to this about 6 months ago and it was (politely) declined.

     
    Bierman9 and MLaVioletteJr like this.
  11. iTunesUpdates

    iTunesUpdates Initiate (0) May 7, 2014 Florida

    Could ask you the same thing.

    But anyway, Todd said "Yes, 40% is historical. So if we look at say 2012 to now, we had recently applied millions of Hads (now Ratings) to the scores which brought it down to roughly 16%. And if we look at just 2014, it's roughly 20%."

    So the last couple of years, it's only 20% of the people filling in reviews. So I take it as the other 80% simply filled in a score for the beer. I highly doubt the majority of beers being reviewed by numbers would support the requirement of having to add more information to a review.

    The numbers show a sign that people would rather not take the time to write a review therefore would not take the time to fill in attributes. It's the 20% of people that do take the time to fill out a review that would't mind this change.

    I don't see why people are in support of this anyway. I understand the viewpoint of BA wanting the change. But from users?? Todd already explained that the averages and scores were not significantly impacted by the previous system, so why do you all care so much on how the rest of us like to rate a beer? It doesn't impact you at all.
     
  12. drtth

    drtth Initiate (0) Nov 25, 2007 Pennsylvania
    In Memoriam

    You could ask but I wasn't the one making claims about numbers so I'll let you do your own homework.

    Honestly I don't care at all how you personally rate a beer. I just like to see people get their facts straight. And if my pointing out to someone that they omitted some from their claim or argument bothers you, there is an ignore button you are free to use any time.

    It most certainly did impact me as a user of the information on this site when the shift to allowing a single rating only took place, but I'm not going to repeat for the third or fourth time how and why I favor the changes most recently made. Continue your argument with the owners of the site.

    Enjoy your day!
     
  13. Todd

    Todd Founder (13,518) Aug 23, 1996 Finland
    STAFF Mod Team Society Pooh-Bah

    Nope, because I never said that.
     
  14. Todd

    Todd Founder (13,518) Aug 23, 1996 Finland
    STAFF Mod Team Society Pooh-Bah

    Me too. Six months ago we were on a much different path, but it made sense when we reevaluated everything.
     
  15. PapaGoose03

    PapaGoose03 Grand High Pooh-Bah (6,057) May 30, 2005 Michigan
    BA4LYFE Society Pooh-Bah

    But they probably like it for the wrong reasons - it's quick and easy to do if you are a ticker, and possibly inaccurate and meaningless to anyone else without justification of the score. BA is a share site, so the 'share' part should be maximized.
     
    Duff27 and TMoney2591 like this.
  16. Todd

    Todd Founder (13,518) Aug 23, 1996 Finland
    STAFF Mod Team Society Pooh-Bah

    If you make something easy, people will naturally gravitate towards it. And our numbers within the last few days indicate that most users who just want to rate are growing accustomed to the attributes. We'll see this continue to increase, and even more so with new users who will only know the system as it stands now.
     
    Duff27 and jmdrpi like this.
  17. Todd

    Todd Founder (13,518) Aug 23, 1996 Finland
    STAFF Mod Team Society Pooh-Bah

    Sure, if you're skimming the surface and reacting to the changes negatively, however, the upside trumps when looking at the bigger picture.

    Examples:
    • We're still catering to both the rater and reviewer.
    • Encourages users to put more thought into their ratings and reviews, which benefits everyone.
    • It's already encouraging more users to review; our roots.
    • Soon we'll be averaging attributes in order to provide even more insight behind the overall score for a beer or place.
    • Everyone is now using the same system and interface, which brings consistency and less confusion to the user experience.
    • It's increasing the validity of the data.
    As for the downside:
    • Generally speaking, people don't like change. So there's always a risk of alienating some users.
    • There's currently a small learning curve, but we're working on that.
    • Inconveniences those who just want to tick / don't want to put any more effort into their rating.
    What's interesting is that the initial pushback has been practically nothing compared to the pushback we received when we introduced quick ratings.
     
    F2brewers and drtth like this.
  18. iTunesUpdates

    iTunesUpdates Initiate (0) May 7, 2014 Florida

    Well I hope it works out for everyone. Thanks for letting everyone discuss this. Even if we don't get our way, at least we get a voice in it.


    Can we at least get a change as far as submitting the ratings? It was nice in the old version that we didn't need to click the submit button. It took me a while to figure out why my ratings we're not saving on the attributes. Didn't realize we need to click submit for it to save.

    It would be nice if it auto-submitted once every attribute field is filled in. Could also help on the learning curve for new users.
     
    #138 iTunesUpdates, Dec 21, 2014
    Last edited: Dec 21, 2014
    drtth likes this.
  19. Todd

    Todd Founder (13,518) Aug 23, 1996 Finland
    STAFF Mod Team Society Pooh-Bah

    We were getting too many complaints with the auto-submit from reviewers. Since the update to a standard submit button, complaints have stopped.
     
  20. jmdrpi

    jmdrpi Grand High Pooh-Bah (8,989) Dec 11, 2008 Pennsylvania
    BA4LYFE Society Pooh-Bah

    What Todd said is the reason people care. Not all ratings were equal in value to the site and level of usefulness to other users.
     
    TMoney2591 and drtth like this.
Thread Status:
Not open for further replies.