1. You need Untappd for Business. Get a demo, get a $25 gift card. It's that easy.
    Dismiss Notice

Updates to the BA Score, Rankings, and Top Rated Beers

Blog Discussion in 'BeerAdvocate Talk' started by Todd, Jul 22, 2019.

Thread Status:
Not open for further replies.
Page 1 of 11
  1. Todd

    Todd Founder (13,506) Aug 23, 1996 Finland
    STAFF Mod Team Society Pooh-Bah Trader

    Yeah. I know what you're thinking. Not again! Why?!

    It was time for some internal disruption.
    • Unfortunately we've seen a drop in the industry using our scores since moving to 1-5 point system. We’d like to change that.
    • We know that many users miss the old 100 point system. In fact, the last poll we took indicated the most users preferred it. Perhaps we should've of listened, but we've learned a lot.
    • The 100 point system feels more BA-like and supports other projects that are in the works.
    • The Top 250 and regional lists became pointless and boring for most; same styles, from the same breweries.
    • We want to place more focus on the beer’s style and style education in general.
    Thanks to feedback from the industry, recent threads, and Society members, I stoked to announce the following updates.

    BeerAdvocate (BA) Score
    Unlike past versions, the math isn’t simple on the new BA Score.
    1. First, whenever a beer is reviewed we obtain the truncated mean. This means we examine all user scores for the beer, but then toss out an equal percentage of outliers on both ends.
    2. Next, we then obtain the beer’s weighted rank (WR) using the truncated mean. This entails running it through a custom Bayesian formula that takes the beer’s style into consideration; specifically the average and average number of ratings across all active beers within the style. This means that a beer is no longer pitted against all beers, but rather all active beers within its style.
    3. Finally, we apply the 100 point score using the beer’s weighted rank.
    A beer must have 10 or more ratings to be assigned a BA Score. And the BA Score is the only score displayed. You won’t find the beer’s average, truncated mean, or weighted rank. (read the update)

    Rankings
    All beers that meet our criteria (WR + activity) are now ranked within their listed style. Rankings are shown on beer pages and used to generate top rated lists for styles. Style data and rankings are updated daily.

    Top Rated Beers
    As we’re no longer comparing a beer against all other beers, we’ve opted to retire the old Top 250 beers, regional lists, etc. Instead, we’ll be focusing on where a beer ranks within its style and the new Top Rated Beers page reflects this new focus. We’ll eventually explore adding more interesting and useful lists, too. (read the update)

    Other than some cosmetic tweaks, that’s it for now. And @Mike is working to support these updates in the app, too.

    I’m currently rolling out the updates, so please be patient. Issues? Let me know. Otherwise I look forward to your feedback.

    Cheers!

    Todd
     
    #1 Todd, Jul 22, 2019
    dmtaylor, BeerRunner, Houlio_99 and 27 others like this.
  2. JerzDevl2000

    JerzDevl2000 Grand Pooh-Bah (3,208) Oct 7, 2005 New Jersey
    Pooh-Bah

    I like it - the pages have a cleaner look and the information is easier to see. I like how more emphasis is being place on styles that taking a beer and comparing it to everything across the board. Keep up the good work!
     
    #2 JerzDevl2000, Jul 22, 2019
    alucard6679, PABrewReview, JediMasterLenin and 2 others like this.
  3. paulish

    paulish Grand Pooh-Bah (3,162) Feb 2, 2014 New York
    Society Pooh-Bah Trader

    Bad news:slight_frown:
     
    #3 paulish, Jul 22, 2019
    Lucoli, VoxRationis and fthegiants like this.
  4. bbtkd

    bbtkd Grand High Pooh-Bah (7,588) Sep 20, 2015 South Dakota
    BA4LYFE Society Pooh-Bah Trader

    Specifically?
     
    #4 bbtkd, Jul 22, 2019
  5. Futbolmanby

    Futbolmanby Initiate (0) Jul 7, 2015 Michigan
    Trader

    Should keep the top 250 as a separate list along with the beer of fame list... it was a cool bucket list type thing for us old timers
     
    #5 Futbolmanby, Jul 22, 2019
    PhineasMcClintock, SnugTeam6, sulldaddy and 38 others like this.
  6. DIM

    DIM Grand Pooh-Bah (4,446) Sep 28, 2006 Pennsylvania
    Society Pooh-Bah Trader

    Looks great!
     
    #6 DIM, Jul 22, 2019
    Viaduck and Todd like this.
  7. superspak

    superspak Grand High Pooh-Bah (10,838) May 5, 2010 North Carolina
    Society Pooh-Bah Trader

    Can we still have an average score listed under the numeric score? I have no idea how the new score correlates with the number, at least show both. There are going to be a bajillon beers that have no score for my reviews too, since there are not enough ratings.

    Love that the top rated beers are by style now though.
     
    #7 superspak, Jul 22, 2019
    Last edited: Jul 22, 2019
    hoptheology, TreyIsWilson, EMH73 and 21 others like this.
  8. paulish

    paulish Grand Pooh-Bah (3,162) Feb 2, 2014 New York
    Society Pooh-Bah Trader

    It's look the same. May be latter we will see a changes.
     
    #8 paulish, Jul 22, 2019
  9. DIM

    DIM Grand Pooh-Bah (4,446) Sep 28, 2006 Pennsylvania
    Society Pooh-Bah Trader

    No, look up any beer.
     
    #9 DIM, Jul 22, 2019
    alucard6679, officerbill, AlcahueteJ and 1 other person like this.
  10. DIM

    DIM Grand Pooh-Bah (4,446) Sep 28, 2006 Pennsylvania
    Society Pooh-Bah Trader

    #10 DIM, Jul 22, 2019
    Todd likes this.
  11. mig100

    mig100 Pooh-Bah (2,645) Aug 3, 2014 Texas
    Pooh-Bah Trader

    I agree with this. Love top beers by style now, but the top 250 lists were a really great feature and should be kept.
     
    #11 mig100, Jul 22, 2019
    BunsMcGillicuddy, Franziskaner, Todd and 20 others like this.
  12. jvgoor3786

    jvgoor3786 Grand Pooh-Bah (4,198) May 28, 2015 Arkansas
    Society Pooh-Bah Trader

    Pages look nice and clean. I appreciate the reasons for the change. I will also miss the Beers of Fame and Top 250. Plus, I really like to know the average rating, since we rate 1-5, not 1-100.
     
    #12 jvgoor3786, Jul 22, 2019
    FBarber, Todd, von_kaiser and 9 others like this.
  13. AZBeerDude72

    AZBeerDude72 Initiate (0) Jun 10, 2016 Arizona

    Not sure I like the top beers list. I see a beer with 1000 reviews rated as #1 but one with 13,000+ reviews is rated #11. To me this is flawed, the formula needs to take into consideration number of reviews. It is pretty clear a beer like KBS should be rated higher. When you take into consideration the number of high reviews it is proof the beer is world class. To me 1000 reviews does not indicate a beer is great.

    Look at KBBS, #1 Imperial Stout with under 800 reviews? That is better than KBS? I really think the formula needs to weight in the number of reviews in order to rank a top beer.


    Double Shot | Tree House Brewing Company

    Wants Gots

    Reviews: 105 | Ratings: 1,078

    #1 ranked American Stout | 7.60% ABV

    KBS (Kentucky Breakfast Stout) | Founders Brewing Company

    Wants Gots

    Reviews: 3,472 | Ratings: 13,664
    #11 ranked American Imperial Stout | 12.30% ABV

    Kentucky Brunch Brand Stout | Toppling Goliath Brewing Company

    Wants Gots

    Reviews: 143 | Ratings: 767
    #1 ranked American Imperial Stout | 12.00% ABV
     
    #13 AZBeerDude72, Jul 22, 2019
    Last edited: Jul 22, 2019
    JediMasterLenin and paulish like this.
  14. tone77

    tone77 Grand Pooh-Bah (4,305) May 20, 2009 Pennsylvania
    Society Pooh-Bah

    I am already missing the top beers by state and country lists. This was a valuable tool when traveling to unfamiliar states/countries, giving me an idea of what beers to keep an eye out for.
     
    #14 tone77, Jul 22, 2019
    Radome, Strohm, BunsMcGillicuddy and 33 others like this.
  15. stortore

    stortore Grand Pooh-Bah (3,276) May 31, 2011 Illinois
    BA4LYFE Society Pooh-Bah

    Totally agree. I have no way to compare my rating to the numeric score.
     
    #15 stortore, Jul 22, 2019
    TreyIsWilson, ilikebeer03, jakecattleco and 8 others like this.
  16. mig100

    mig100 Pooh-Bah (2,645) Aug 3, 2014 Texas
    Pooh-Bah Trader

    Agree 100% with both of these points also. These features made BA stand-out vs. the other beer rating sites/apps.
     
    #16 mig100, Jul 22, 2019
    ewpass, jakecattleco, Todd and 7 others like this.
  17. paulish

    paulish Grand Pooh-Bah (3,162) Feb 2, 2014 New York
    Society Pooh-Bah Trader

    Now I have only one option (app) for hunting a beer when I traveling. One week ago I had а two, including BA.
     
    #17 paulish, Jul 22, 2019
    MJSFS and tone77 like this.
  18. GratefulBeerGuy

    GratefulBeerGuy Pooh-Bah (2,906) May 20, 2006 New Hampshire
    Society Pooh-Bah Trader

    100 point scale=thank you!!
     
    #18 GratefulBeerGuy, Jul 22, 2019
    MJSFS, officerbill, CaptainHate and 1 other person like this.
  19. RaulMondesi

    RaulMondesi Grand Pooh-Bah (5,221) Dec 11, 2006 California
    Society Pooh-Bah Trader

    Speaking for the numerically inept, I am happy to see the 100 point scale back!
     
    #19 RaulMondesi, Jul 22, 2019
    MJSFS, JediMasterLenin, kuhndog and 1 other person like this.
  20. Mebuzzard

    Mebuzzard Grand Pooh-Bah (4,278) May 19, 2005 Colorado
    Pooh-Bah Trader

    Sure are a lot of 100s for the NE IPA style.
     
    #20 Mebuzzard, Jul 22, 2019
    alucard6679, Prince_Casual and Tripel_Threat like this.
Page 1 of 11
Thread Status:
Not open for further replies.