Proposed Updates to Top Rated Beer Lists

Blog Discussion in 'BeerAdvocate Talk' started by Todd, Dec 28, 2021.

Thread Status:
Not open for further replies.
  1. LesDewitt4beer

    LesDewitt4beer Grand High Pooh-Bah (6,315) Jan 25, 2021 Minnesota
    Society Pooh-Bah Trader

    It all makes sense to me in the ever changing landscape and revolving doors of beers. Especially in now times, as you mention, just the sheer number of new US breweries and offerings alone not to mention distribution issues/disruptions we sometimes face now. I embrace all 3 main points: Raw Average raking in all numerical ratings, the proposed "active only beers"(2 yrs is IMO a fair amt of time although some beers are very slowly rotational vs 'one off') which makes way for your 3rd point proposing a lower minimal number of ratings to 5 thus creating more area/visibility for new beers. Sensible changes Todd for Top Rated Beers. Cheers!
     
  2. Rug

    Rug Grand Pooh-Bah (3,454) Aug 20, 2018 Massachusetts
    Pooh-Bah Trader

    Yeah I feel like this is important. I see many local and smaller breweries in general who are just shy of that 10 review cutoff on some beers
    I also agree with this. Wouldn't even be too hard to go back and archive previous years. Maybe when you navigate to the top 250 it defaults to the current year but there's a drop down box where you could check the year you want
     
  3. IPAExpert69

    IPAExpert69 Savant (1,065) Aug 2, 2017 Pennsylvania

    And this little snippit is exactly why this change is warranted, give small brewers an opportunity to be discovered. Heck there were so many breweries right in my local area I was completely blind to until I became active on BA. And isn't that kinda the entire point?
     
  4. cryptichead

    cryptichead Grand Pooh-Bah (4,897) Jul 3, 2014 Illinois
    Mod Team Society Pooh-Bah Trader

    All the proposed changes make sense to me. I say go for it!
     
  5. FBarber

    FBarber Grand High Pooh-Bah (7,325) Mar 5, 2016 Illinois
    Mod Team BA4LYFE Society Pooh-Bah Trader

    This is where I think this change is going to be the biggest boon for BA and for us users. It will allow for my dynamism in the regional, state and style listings which are lists that I personally use on occasion to find new stuff.

    Edit: @IPAExpert69 beat me to this point.
     
  6. papposilenus

    papposilenus Grand Pooh-Bah (3,232) Jun 21, 2014 New Hampshire
    Pooh-Bah Trader

    My issue here - and I don't know if I've actually raised it before or only said it in my head - is that you have way more raters throwing up straight 5's than 1's. Using raw averages would seem to result in a higher average than might be otherwise be warranted.

    Many times beers that were initially added to the database as one-offs are subsequently brewed again, as an anniversary beer, or go into rotation. Whenever I come across one of these - not infrequently - I submit an edit request but I notice that other reviewers have been adding reviews in the meantime. I assume that there are a fairly huge number of these that I haven't stumbled across. For this reason, whenever I add a beer to the database, I add it as a rotator pretty much regardless - I apologize if this is dickish.

    100% yes. I often feel lonely and irrelevant drinking all these low-traffic northern New England and Québec beverages and crave validation.
     
  7. Todd

    Todd Founder (13,518) Aug 23, 1996 Finland
    STAFF Mod Team Society Pooh-Bah

    Depends. I found the reverse when looking at the Top 250. Many of those averages dropped.
    It's certainly not helpful, accurate, and will ultimately result in more reports/works for mods. But it's not always easy to tell if a beer is a one-off either.
     
  8. JohnnyHopps

    JohnnyHopps Grand Pooh-Bah (3,380) Jun 15, 2010 Indiana
    Pooh-Bah Trader

    Messing with the top 250 list really throws some people’s world in the chaos. How about expanding it to the top 500!?! … I bet that would get the trade forums moving!
     
    hopley, Sammy, REVZEB and 4 others like this.
  9. Bhubbard34

    Bhubbard34 Pooh-Bah (2,585) Mar 4, 2016 Pennsylvania
    Society Pooh-Bah Trader

    I Like the proposed changes Todd.

    Just a little confused because I thought only active beers appear in the top lists now as it is. Currently retired beers are not eligible anyway, so not sure how this is a change? What am I missing?

    lowering the minimum number of ratings to 5 is a good idea, and it is not going to affect the Top 250. I don’t think people understand there is an “unknown weighted formula” Todd uses to get the rankings. Just because a new beer gets “5” perfect 100 scores, does not mean it’s instantly jumping into the top 10. It still is put through a weighted formula to get ranked.
     
  10. Smakawhat

    Smakawhat Grand High Pooh-Bah (7,191) Mar 18, 2008 Maryland
    BA4LYFE Society Pooh-Bah

    I think the change from 10 to 5 is a good idea since it will open up people to more beers and breweries, just as Todd mentioned.

    Often at times many of the inactive beers I find aren't inactive either, they just haven't been rated in a long time, so I just find them when I happen to review them and sent a note to the staff to un-retire the beer.
     
  11. Tucquan

    Tucquan Grand Pooh-Bah (3,116) Oct 11, 2007 Pennsylvania
    Society Pooh-Bah Trader

    I don't know if it is already the case but my suggestion is to only consider beers that meet at least the minimum number of characters to be considered a review.
     
    Whyteboar likes this.
  12. Bhubbard34

    Bhubbard34 Pooh-Bah (2,585) Mar 4, 2016 Pennsylvania
    Society Pooh-Bah Trader

    Ratings vs reviews are two different things. I believe all of these changes are directly related to ratings, not reviews
     
    Beer_Economicus and mactrail like this.
  13. Gkruszewski

    Gkruszewski Grand Pooh-Bah (5,859) Nov 1, 2013 New York
    BA4LYFE Society Pooh-Bah Trader

    Can we please have a top 100 list for retired beers… or beers that are only brewed annually…
     
    hopley, ZebulonXZogg, REVZEB and 8 others like this.
  14. jvgoor3786

    jvgoor3786 Grand Pooh-Bah (4,222) May 28, 2015 Arkansas
    Society Pooh-Bah Trader

    I had this issue last night. I went to a brewery out of town and entered a new beer. I had no idea if it was a one-off, rotator, or even a regular menu item. I just make my best guess.
     
  15. plaid75

    plaid75 Grand Pooh-Bah (3,672) Jan 13, 2005 New York
    Society Pooh-Bah Trader

    Since likely most of the beers to which you refer are subregional, I don't see the value of featuring them on the top beer list if the intended purpose for doing so is to expose the beer to more people.

    Perhaps dealing with this on a regional basis would better serve the purpose of exposing top beers to people who are actually in the position to drink them.
     
    PapaGoose03 and BBThunderbolt like this.
  16. dbrauneis

    dbrauneis Grand High Pooh-Bah (8,071) Dec 8, 2007 North Carolina
    Mod Team BA4LYFE Society Pooh-Bah Trader

    When adding a beer, the default is now “One-off” and I think that is reasonable unless you know it will be rotating or year-round. There are tons of beers that have been added as rotating but were one-offs in the database that have yet to be reported (hence the inactive lists for beers that have not been rated/reviewed in over two years).
     
  17. dbrauneis

    dbrauneis Grand High Pooh-Bah (8,071) Dec 8, 2007 North Carolina
    Mod Team BA4LYFE Society Pooh-Bah Trader

    Only active beers currently appear in the top lists - previous to the addition of inactive there were only two choices (active or retired). With the addition of inactive (not retired on BA but not reviewed/rated in over two years), there are now three choices. The proposal is only to consider active beers and exclude retired and inactive (not reviewed/rated in over 2 years).
     
    PapaGoose03, Bhubbard34, Todd and 2 others like this.
  18. misteil

    misteil Pooh-Bah (1,649) Feb 21, 2019 Ireland
    Pooh-Bah

    Please do this! I’ve wanted this for yonks but never actually mentioned it. The Irish top rated beers list is just ridiculously inaccurate, because the best stuff being made these days is never getting more than 10 reviews. This change would really help I suspect. Thank you.
     
  19. Todd

    Todd Founder (13,518) Aug 23, 1996 Finland
    STAFF Mod Team Society Pooh-Bah

    Correct. This update is looking at the numbers (ratings), not text (reviews, which all have a rating attached to them).
     
  20. woodchipper

    woodchipper Grand Pooh-Bah (3,735) Oct 25, 2005 Connecticut
    Society Pooh-Bah Trader

    I am generally in favor of your proposals, but like everyone here, wondering what the real results will be. Have you considered creating a sandbox version of this that you and maybe some moderators can review and look for unintended consequences before going live with it?
     
    Beer_Economicus, o29, Todd and 4 others like this.
Thread Status:
Not open for further replies.