Beer Ranking by Style?

Talk Discussion in 'BeerAdvocate Talk' started by SLeffler27, Sep 22, 2018.

Thread Status:
Not open for further replies.
  1. SLeffler27

    SLeffler27 Grand Pooh-Bah (4,906) Feb 24, 2008 New York
    BA4LYFE Society Pooh-Bah Trader

    How do folks feel about adding “Rank by Style” to the individual beer’s stats? I think this may influence one’s review, towards style away from personal taste.
     
  2. Squire

    Squire Grand Pooh-Bah (4,385) Jul 16, 2015 Mississippi
    BA4LYFE Society Pooh-Bah Trader

    I don't know, really. It seems to me that those who consider style usually mention it in their review which is perhaps close to what you are suggesting.
     
  3. SLeffler27

    SLeffler27 Grand Pooh-Bah (4,906) Feb 24, 2008 New York
    BA4LYFE Society Pooh-Bah Trader

    My thought here is; how we might address style bias.

    Some great beers may be overlooked simply because the overall rating is compared to all beers. Similarly if one knows the beer in front of them is highly/poorly regarded, might that influence the individual’s opinion, or cause them to be more considerate when forming their opinion?

    I quickly surveyed the “Top by Style” lists, and found some Best of Style beers have thousands of beers that are statistically overall better. The No.1 German Alt Beer is ranked 4,079th of all beers. Might we be better educated if the rank by style statistic is front and center?
     
    Junior likes this.
  4. SLeffler27

    SLeffler27 Grand Pooh-Bah (4,906) Feb 24, 2008 New York
    BA4LYFE Society Pooh-Bah Trader

    Your point here supports the notion that there are at least two types of ways people review beer on BA. This is a well discussed dichotomy of by defined style vs per personal preference. Rules aside, the reality is that this dichotomy exists. Maybe there is a means by which it can be mitigated.
     
    Junior likes this.
  5. Ceddd99

    Ceddd99 Zealot (609) May 14, 2018 Michigan
    Trader

    I think mitigating is a complex problem. Rating to style would make the most sense if everyone rating the beer had extensive knowledge of the style and at least some appreciation for it.

    But what about if you've only had one or two other beers in that style? Would you give it a high rating just because it was the best of those three? What about if you don't like the style? Then you might rate a beer that was not really true to the style higher than the best/most classic examples of the style because you don't like the style and prefer the outlier.

    So rating to style poses its own problems.

    In general I feel like a lot of people don't like giving beers that they don't like very much high ratings just because they are good within the style. For example, I don't really like IPAs so It would feel really weird to me to give an IPA a 5. How much you like the style tends to come through in your rating even when you rate to style in the sense that I generally rate my favorite beers from my favorite styes higher than my favorite beers from styles I am less fond of.

    I do make an effort to rate to style though, because how else can you compare a sour ale against a light lager? Which one is better is going to largely depend on what mood you are in. I rarely drink light lagers, but I have to admit they can really hit the spot in hot weather. Hence one could argue that a well made light lager should receive just as high rating as a stout or IPA.

    On the other hand I think you could argue some styles have inherently more potential for flavor than others. For instance, take the top beer list. I feel like a light lager would be somewhat out of place in the top 50 beers even if it was the best light lager in the word.
     
    #5 Ceddd99, Oct 20, 2018
    Last edited: Oct 20, 2018
  6. woodychandler

    woodychandler Grand High Pooh-Bah (7,184) Apr 9, 2004 Pennsylvania
    BA4LYFE Society Pooh-Bah Trader

    After having been metaphorically taken behind the woodshed a few times, I now ALWAYS rate to Style & not to personal taste, except for the Overall score, which remains my opportunity to give a numerical side to the verbiage in my review. I also make it a point to mention that I am reviewing to Style, especially if I am giving a beer what might be CANsidered a CANtentious score.

    Unsure of how to rate to Style? This site's revamped "Beer Styles" guide should be your first stop. I used to have the old entries virtually memorized, but some of them were too short & pithy to be of real use. The new ones are abfab. Want even more? Get the BJCP app! I have BJCPDroid & I LOVE it, not just for Style guidelines, but also for SRM eyeball measurements. YMMV.
     
  7. StoutElk_92

    StoutElk_92 Grand Pooh-Bah (4,045) Oct 30, 2015 Massachusetts
    Pooh-Bah

    Rate it how you want, it’s all subjective anyway. If I rate a Pilsner a 5 most people won’t like it that much or think it’s a 5, and if I rate a stout a 5 some people don’t like stouts, some people don’t like IPAs, etc. it’s all your personal preference. I wouldn’t suggest rating beers higher than others if you don’t like them as much though. Then looking back at your ratings you might have some beers on your top list that you don’t like as much as the higher rated beers from the styles you like more. Just rate it as a beer. How good do you think it is for what it is going for, or for a beer within that style range. It doesn’t have to be exact science to count, it’s what you like. Everyone’s ratings are different.
     
    GreenBayBA and Squire like this.
  8. Hoppsbabo

    Hoppsbabo Pooh-Bah (2,053) Jan 29, 2012 England
    Pooh-Bah

    Not keen at all. One, because styles are often too hard to pin down and two, imagine giving a really delicious beer low marks just because it doesn't fit the style definition.
     
    GreenBayBA, rgordon and StoutElk_92 like this.
  9. TongoRad

    TongoRad Grand Pooh-Bah (3,884) Jun 3, 2004 New Jersey
    Society Pooh-Bah Trader

    We're asked to rate "with style in mind" and not "to style'- this eliminates the need to dock points for not being strict enough in one's interpretation, and it goes a long way towards reducing style bias if people were to do it that way.
     
  10. Ceddd99

    Ceddd99 Zealot (609) May 14, 2018 Michigan
    Trader

    That's what happened with me. For example, I rated Perrin Light Lager a 4.33 because it was the best light lager I've had and that rating is significantly higher than the 3.46 I gave to Spaten Oktoberfest because even though I like Spaten, I prefer other Oktoberfests. But if I had to compare Spaten with the light lager side by side, I would think Spaten is a much better beer. I don't think Perrin Light Lager is a great beer overall, it's just great as a Light Lager. Ninety percent of the time I am going to prefer the Oktoberfest but on a summer day in the mid 90s I will prefer the light lager.
     
  11. rgordon

    rgordon Pooh-Bah (2,701) Apr 26, 2012 North Carolina
    Pooh-Bah

    This is exactly why I think codified beer style guidelines is/are interesting as a geeky art at best, and an endless source of confusion. Some beer "experts" just like to have things all tidy. I just like beer and buy what looks interesting. Being so precise about beer style nomenclature can be taken to the extreme.
     
    Hoppsbabo and Squire like this.
  12. scream

    scream Initiate (0) Dec 6, 2014 Wisconsin
    In Memoriam

    Not entirely the same, but it might be nice to be able to sort a person's ratings by style. It would give one an idea of how a person rated beers of the same style to see how they rated beer a as compared to beers c,d,e etc.
     
    GreenBayBA and beergoot like this.
  13. Todd

    Todd Founder (13,518) Aug 23, 1996 Finland
    STAFF Mod Team Society Pooh-Bah

    Stats along these lines are available for Premium members.
     
    Junior, jkblr and scream like this.
  14. SLeffler27

    SLeffler27 Grand Pooh-Bah (4,906) Feb 24, 2008 New York
    BA4LYFE Society Pooh-Bah Trader

    The suggestion is to show each particular beer's rank by style, in addition to, or in place of the overall rank. This is about how people perceive a beer, before reviewing or possibly before purchase.

    And style bias is less about defined styles, than it is about personal taste for a beer that shares common characteristics which one may prefer or avoid. While a large sample may cancel out the outliers, it is incapable of addressing a skewing due to large contingents of reviewers who rate low/high based on personal taste regarding characteristics that are intended by the brewer.

    Another idea to tackle the concern is to institute a new class of reviewers. Similar to the now gone "Bro's Score" only with a larger group of preselected "Beer Advocate Judges".

    Ultimately this may be a minor concern. But... some of us enjoy a wide range of beers, and I am concerned that over time, personal tastes may focus-in on a narrow range of beer, simply due to a form of follow the leader. This narrowing could subvert the diversity we enjoy today.
     
    THANAT0PSIS likes this.
  15. mudbug

    mudbug Pooh-Bah (1,762) Mar 27, 2009 Oregon
    Pooh-Bah

    I've always had a problem with the top beers lists that didn't handicap for style bias. In fact I would give far more credence to a top 100 beers by style than any list we've seen so far. Remember, if only a small fraction of Bud Light drinkers joined Ba and voted for their favorite beer Bud Light would be the top beer on every list BA has
     
    SLeffler27, Ceddd99, scream and 2 others like this.
Thread Status:
Not open for further replies.