Welcome to BeerAdvocate!

Looking to talk, rate or trade beer? Join today by creating your free account.

Dismiss Notice
Curious about recent updates to the site and app? Check the Announcements forum for updates.
Dismiss Notice
Love Belgian Beer?

Join us Sep 17 in Portland, Maine for Return of the Belgian Beer Fest, featuring hundreds of authentic Belgian beers and Belgian-inspired offerings.

Tickets + more: beeradvocate.com/belgian

Updates: Top 250 Beers & More!

Discussion in 'Announcements' started by Todd, Jan 19, 2013.

  1. ant880

    Joined:
    Nov 7, 2010
    Posts:
    790
    Likes Received:
    2,598
    Location:
    New York
    I believe to qualify for the top 250, a beer should have a minimum of 100 reviews plus it must continue to be reviewed at a minimum of a 4 average after at least three separate threads in three consecutive years in which it is deemed "not as ____ as last year's batch." No need for a statistician....
     
  2. Sludgeman

    Beer Trader

    Joined:
    Aug 17, 2012
    Posts:
    689
    Likes Received:
    2,351
    Location:
    District of Columbia
    I've searched for this question before I posted, so please excuse if this has already been discussed.

    Top 250 Beers vs Beers of Fame
    Look at the top three and in particular Pliny the Elder and Heady Topper. In the Top 250, Heady is #1 and Elder is #3. In Beers of Fame Elder is #1 and Heady is #3. In both lists both beers have the same number of reviews, but different WRs. Why?
     
  3. Todd

    Todd Founder
    Staff Member Fest Crew Subscriber

    Joined:
    Aug 23, 1996
    Posts:
    6,981
    Likes Received:
    17,744
    Location:
    Colorado
    Different data sets/min thresholds.
     
  4. starrdogg

    Beer Trader

    Joined:
    Jun 21, 2010
    Posts:
    938
    Likes Received:
    719
    Location:
    District of Columbia
    One interesting thing that I noticed - at one point, you could only rate Hads 1-5 without any decimals. If I had a beer that I thought was worthy of a score higher than a 4, I gave it a 5. I certainly would not have given most of these beers 5s had I actually reviewed them. The spectrum would've gone anywhere from 4.2-4.9 or so. I went back and changed all my scores to include decimals, but I'm guessing most people haven't done that. There are probably a ton of old 5 scores out there that are artificially inflating the overall scores of the beers for that reason.
     
  5. Todd

    Todd Founder
    Staff Member Fest Crew Subscriber

    Joined:
    Aug 23, 1996
    Posts:
    6,981
    Likes Received:
    17,744
    Location:
    Colorado
    FYI: the 1-5 Hads without increments occurred for a very short period of time (initial launch over a year ago) and was updated to include .25 increments almost immediately based on user feedback. We're not concerned as a result.
     
  6. Sludgeman

    Beer Trader

    Joined:
    Aug 17, 2012
    Posts:
    689
    Likes Received:
    2,351
    Location:
    District of Columbia
    Your answer confuses me. If the data sets are different then why do both lists for both beers show the same number of reviews, that would be indicative of the same data sets. Unless there is an error in the number of reviews shown. Also the minimum thresholds should not apply in this case - Heady and Elder switching places between first and third - since both have the minimum number of reviews and the minimum number of years. Am I still missing something?
     
  7. Auror

    Beer Trader

    Joined:
    Jan 1, 2010
    Posts:
    1,306
    Likes Received:
    1,070
    Location:
    Massachusetts
    The beers themselves have the same number of reviews. But Heady and Pliny have different number of reviews from each other. The way the WR (Weighted Rating) is calculated, beers with smaller number of reviews are pulled more towards the mean. The strength of the pull is different in each because the Beers of Fame list has a higher anchor. Heady has 24x the minimum number of reviews for the popular list, but only 1.2x the minimum for the fame list, so it is pulled much more drastically towards the mean on the second list.
     
    Onenote81 and Sludgeman like this.
  8. Sludgeman

    Beer Trader

    Joined:
    Aug 17, 2012
    Posts:
    689
    Likes Received:
    2,351
    Location:
    District of Columbia
    Thanks
     
  9. Ri0

    Ri0
    Beer Trader

    Joined:
    Jul 1, 2012
    Posts:
    7,161
    Likes Received:
    62,126
    Location:
    Wisconsin
    Does anyone else think that beers that were only brewed once should be excluded from the popular style list? I was looking at American stouts and many in top 50 were only brewed one time.
     
  10. Todd

    Todd Founder
    Staff Member Fest Crew Subscriber

    Joined:
    Aug 23, 1996
    Posts:
    6,981
    Likes Received:
    17,744
    Location:
    Colorado
    No. We shouldn't penalize a beer/brewer because it was only brewed once. Time will take care of this. As per my original post, we're once again retiring beers tagged as "limited." Before this updated was made, nearly 3,000 beers were retired; excluding them from all lists.
     
  11. Ri0

    Ri0
    Beer Trader

    Joined:
    Jul 1, 2012
    Posts:
    7,161
    Likes Received:
    62,126
    Location:
    Wisconsin
    Thanx Todd. That makes sense.
     
  12. BILF

    Joined:
    Jan 9, 2010
    Posts:
    947
    Likes Received:
    7,819
    Location:
    Israel
    I like the "had's" style of giving a quick rating because i don't feel that i have had enough exposure to beer in general to provide a meaningful and usefull review. I enjoy the reviews that the Bro's do because of the rich descriptions they give. As they say - send 'em more beer. I did four reviews and then stopped because in reality i had no clue and was making shit up just to sound good.
     
  13. UncleJimbo

    UncleJimbo Site Editor
    Staff Member Subscriber Beer Trader

    Joined:
    Sep 11, 2002
    Posts:
    664
    Likes Received:
    268
    Location:
    Massachusetts
    I don't follow your logic. If you feel you are unqualified to write a "meaningful and useful review", then how can you be qualified to give a score with your Had?
     
    flexabull and Beerandraiderfan like this.
  14. dbrauneis

    dbrauneis Site Editor
    Staff Member Subscriber Beer Trader

    Joined:
    Dec 8, 2007
    Posts:
    1,838
    Likes Received:
    1,244
    Location:
    North Carolina
    I can certainly see a case where someone understands the style and can tell whether or not they like it (and thus give it a relative score) but perhaps are not quite comfortable in properly describing all the elements of the appearance, smell, taste, and mouthfeel - I sort of think of a had as the moral equivalent of an overall score.
     
    BILF likes this.
  15. Beerandraiderfan

    Joined:
    Apr 14, 2009
    Posts:
    1,259
    Likes Received:
    1,135
    Location:
    Nevada
    Case in point: Why hads shouldn't count as much (or at all) towards a beer's score.
     
    kevanb and flexabull like this.
  16. fredmugs

    Beer Trader

    Joined:
    Aug 11, 2012
    Posts:
    3,593
    Likes Received:
    18,235
    Location:
    Indiana
    I didn't make that post but when I read reviews I can see multiple people claiming different "notes" in the same beer. Obviously they are not all right. Since I typically cannot detect (or describe) all of the "notes" I do not feel qualified to write a review on it. Honestly I don't give a shit what the beer looks like either. Taste is at least 90% and aroma is the rest.
     
  17. Bitterbill

    Beer Trader

    Joined:
    Sep 14, 2002
    Posts:
    5,547
    Likes Received:
    14,743
    Location:
    Wyoming
    And like myself, the Bros don't mind throwing in a Had vs Review now and then. As long as you have and perhaps enjoy or not the brew you're drinking, it's still a useful tool to rate it as a Hads. IMHO, of course.
     
  18. NastyNate11

    Joined:
    Jan 13, 2013
    Posts:
    133
    Likes Received:
    565
    Location:
    North Carolina
    I can decide for myself if I like a song on the radio(and where it ranks comparatively speaking to others I've heard), even if I can't name the "notes" used in it.

    I dig "Had" reviews
     
    sneezye likes this.
  19. gjoker321

    Beer Trader

    Joined:
    Dec 26, 2007
    Posts:
    678
    Likes Received:
    6,722
    Location:
    Florida
    This is great, good stuff!
     
  • About Us

    Your go-to website for beer (since 1996), publishers of BeerAdvocate magazine (since 2006) and hosts of world-class beer events (since 2003). Respect Beer.
  • Return of the Belgian Beer Fest

    BeerAdvocate Brings its All-Belgian Fest to Portland, Maine on September 17, 2016. Tickets are on sale now.

    Learn More
  • Get the Mag

    Become a BeerAdvocate magazine print subscriber today.

    Subscribe