Update: Top Beer Lists (m = 10)

Blog Discussion in 'BeerAdvocate Talk' started by Todd, Aug 17, 2015.

Thread Status:
Not open for further replies.
  1. Todd

    Todd Founder (13,518) Aug 23, 1996 Finland
    STAFF Mod Team Society Pooh-Bah

    As it applies to our Top Beer Lists, m = minimum ratings required to be considered and used in our formula to calculate all weight ranks in the lists.

    weighted rank (WR) = (v ÷ (v+m)) × R + (m ÷ (v+m)) × C​

    R = average (mean) rating for the beer = (Rating)
    v = number of reviews for the beer = (votes)
    m = minimum number or reviews required to be considered
    C = the mean rating across the dataset​

    Last year we changed m to a dynamic value to represent the average number of ratings across the dataset, which meant that for each list m would be different. It worked well when Hads (or ticks; ratings with no reviews) were applied to the overall scores, however, since we've gone back to our roots this previous update no longer works. The Top 250 and Beers of Fame became a bit too similar, Top New Beers was off, and several state and country lists were dominated by larger regional and national breweries in the area due to their large distribution footprint and subsequent impact on m. Without ticking, this didn't allow much of a chance (if any) for smaller breweries to break the lists with exceptional beers and would eventually result in stagnant lists.

    So m is now 10 across the board for all lists. By applying this consistently it normalizes the lists, and they once again become more dynamic and fun.

    For those who feel that this is an arbitrary number, it's not. We selected 10 as it represents the minimum number of reviews required to achieve a BeerAdvocate Overall Score (BOS), and we feel that once a beer has reached this milestone it should have a fair shot. And it used to be this way back in the day.

    For those who feel that this number is too low, it's not. Sure, you'll see beers with a low number of reviews creep up the lists, but they'll need longevity and consistency to stay there.

    And finally we've added an unknown (to you) factor or two in order to make the lists even more relevant.

    Top 250 Beers

    Enjoy.
     
    Theniz, leantom, Mikexw and 41 others like this.
Thread Status:
Not open for further replies.