The score doesn't match the details.

Talk Discussion in 'BeerAdvocate Talk' started by Longhorn08, Oct 2, 2020.

Thread Status:
Not open for further replies.
  1. beer_beer

    beer_beer Pooh-Bah (2,306) Feb 13, 2018 Finland
    Society Pooh-Bah

    And the total rating is graded to the second decimal. I'm ok with that, always waiting with anticipation for the number! For some reason I take the numbers as a tool for how I feel about and evaluate the different factors right then. It develops the senses with time I think. One number is just a part of the process, even if trying to be honest, which is the way forward.
     
    #61 beer_beer, Oct 3, 2020
    Last edited: Oct 3, 2020
    Singlefinpin and mikeinportc like this.
  2. shelby415

    shelby415 Pooh-Bah (2,098) Oct 10, 2011 Oregon
    Pooh-Bah Trader

    Thanks for this! As a teacher, I have these conversions ingrained and I almost always think of each beer's characteristics as a letter grade first, before converting to numerical for the score. This is why I cringe when I see so many reviewers call a beer "solid" and claim they'd gladly revisit it yet give it a 3.25 (more-or-less the equivalent of an F). A lot of reviews are marred by this dissonance between what the reviewers think and the score they give. I think you pinpoint the reason for the bulk of the problem - forgetting or not realizing there is no 0-1 on the scale.
     
    Singlefinpin and MrOH like this.
  3. LiquidAmber

    LiquidAmber Grand Pooh-Bah (5,734) Feb 20, 2009 Washington
    BA4LYFE Society Pooh-Bah

    I believe "ratings" like this are an artifact of not having a "had" tick option without ratings. BA used to have this option. I believed at the time that not having this option would lead to artificial ratings because people faced with a forced option on a form will just fill in something to get the form finished. I wanted an unrated tick because I wanted to note beers that I had tried, but were of styles I wasn't fond of; I didn't feel that it was right to review something where my rating was heavily weighted on personal taste rather than quality or flavor comparison with similar styles.
    I'm a huge fan of reviews and try to review every new beer I try, so I understand BAs push to encourage everyone to give meaningful reviews when they rate something, but blanket random average "ratings" are the result of the policy of not having a tick option IMHO.
     
  4. ScaryEd

    ScaryEd Grand Pooh-Bah (3,793) Feb 19, 2012 New Hampshire
    Society Pooh-Bah

    No I think you understood perfectly.

    I'm going around in circles here
    No you understand perfectly.

    I'm just trying to find the middle ground here I guess. So I shouldn't review a beer from a style I hate, even if I want to give it a chance? Say a friend knows I don't like this one style, but recommends a beer he thinks I'll actually enjoy. So I try it, and ultimately don't like it. So I shouldn't review that beer?

    I guess that's fine, but what if I liked it? Can I review it then?

    I don't know, I'm overthinking things. I've always rated to taste, which I suppose can be troublesome since I'm going to rate a "great" NEIPA far higher than a "great" AAL. I kinda see the issue there. If they're both great, they should have a similar rating.

    But like I said, I'm going to keep the "How to" in mind going forward.
     
  5. StoutSnob40

    StoutSnob40 Grand Pooh-Bah (4,611) Jan 4, 2013 California
    Society Pooh-Bah Trader

    Mine was a criticism on my history with various women. Haha
     
  6. steveh

    steveh Grand Pooh-Bah (4,174) Oct 8, 2003 Illinois
    Society Pooh-Bah

    Looking at some of your reviews, I don't have access to many of those NAs -- including your highest rated. ISO.
     
    Singlefinpin likes this.
  7. beer_beer

    beer_beer Pooh-Bah (2,306) Feb 13, 2018 Finland
    Society Pooh-Bah

    No worries, they are a bit difficult to get one's hands on. I'm having some new shipped from Germany, waiting! Maybe try the ones in your local store now, and then look again in some months.
     
    officerbill and Singlefinpin like this.
  8. unlikelyspiderperson

    unlikelyspiderperson Grand Pooh-Bah (3,966) Mar 12, 2013 California
    Pooh-Bah Trader

    For what its worth, my personal opinion is that you should rate it either way (assuming you want to, you can always just drink beer if you want) but should make some effort to consider how well it hits its goal. I, personally, try to note on the review if its a style I don't particularly like and then explain why I think it hits or misses its target.

    I've come to like reviewing styles I don't really like because it makes the experience more analytical and somehow then more tolerable
     
    lucius10, officerbill, Junior and 3 others like this.
  9. steveh

    steveh Grand Pooh-Bah (4,174) Oct 8, 2003 Illinois
    Society Pooh-Bah

    Oh, I definitely have tried many in recent months -- most available are pretty bad, but there are definite standouts I look for.

    Not to mention a good, new influx of low-alcohol beers that are very tasty: see Bell's Light Hearted (probably not available to you).
     
  10. beer_beer

    beer_beer Pooh-Bah (2,306) Feb 13, 2018 Finland
    Society Pooh-Bah

    Thanks for the tip, my next order could well go to the States!
     
    Singlefinpin and steveh like this.
  11. gopens44

    gopens44 Grand Pooh-Bah (3,560) Aug 9, 2010 Virginia
    Pooh-Bah Trader

    When reviewing, I find it difficult to find superlatives that fall in the mid to high 3 rating because in general, this is above average but when compared to rating and overall expectations by how everything is rated, below 4 is a bust, which brings me to the bigger issue, inflation. "3" really means average, "4" should be the exception to the average and "4.5-5" really should be the 1% exception. I've been guilty of it as well, slowly trying to work my ratings slightly lower but it's still not going to align with everyone else's and would certainly make a beer with few reviews look less appealing than it's peers, and unfairly as well. Maybe someone can tweak the algorithms to account for inflation or grade on a curve or something.
     
    Singlefinpin, mikeinportc and MrOH like this.
  12. MrOH

    MrOH Grand Pooh-Bah (3,995) Jul 5, 2010 Virginia
    BA4LYFE Society Pooh-Bah

    I kinda view it like this:

    Once a year me and my buddies scrounge up the funds for an off-shore fishing trip on a charter. It is my favorite fishing of the year, but obviously, I can't go fishing offshore every week. So I just appreciate sitting on the side of the pond with a bobber and worm for some sunfish, maybe rent a rowboat or kayak at the local reservoir state park to catch some bass, or hit up the local creeks in the spring when they are stocked with trout. They are all enjoyable, and I appreciate them all for what they offer. If I was a snob, I wouldn't tend to do anything but fish off-shore, and if I did, I would talk shit about it for not being offshore fishing.
     
  13. unlikelyspiderperson

    unlikelyspiderperson Grand Pooh-Bah (3,966) Mar 12, 2013 California
    Pooh-Bah Trader

    I don't think that's the way the rating system here is actually designed. We aren't rating on a curve. It could actually be the case that a lot of breweries are putting out a lot of good stuff that deserves a 4+ rating.

    In theory, there could be hundreds (or even thousands) of "world class" examples of a given style. My personal experience is that most of the beers I drink tend to fall into the 3.75-4.25 range, for me.

    Lots of very good and outstanding beers out there these days
     
    ChicagoJ, officerbill, MrOH and 5 others like this.
  14. Apathetiq

    Apathetiq Pundit (766) Sep 10, 2012 Massachusetts
    Trader

    Absolutely agree with this one! Beer is not terroir dependent (set aside spontaneous), as in there are no "objectively better situations for something." Same yeast, similar grain, mimic the water chemistry, buy pelletized hops, you can fairly accurately replicate a brew often enough.

    I do wish that rating systems had weighted votes within styles. No reason why someone who has had 10 saisons vote should count the same as another reviewer with 200. Experienced drinkers need to have the ability to call out flaws (*cough* THP in 'sours') in an impactful way and fit a representation into the larger category.
     
  15. BillAfromSoCal

    BillAfromSoCal Pooh-Bah (2,415) Aug 24, 2020 California
    Society Pooh-Bah

    If I could "like" this comment more than once I would. I absolutely believe that there is real value applying greater weight to opinions from people who have sampled more of the universe of beers within a style, and I do not think the Karma points are at all a good indicator of that since experience in one style has zero to do with experience in another.
     
  16. Singlefinpin

    Singlefinpin Pooh-Bah (2,400) Jul 17, 2018 North Carolina
    Pooh-Bah Trader

    Rating beer is subjective. It's a product of the beer drinkers bias. To rate a beer objectively requires one's personal bias to not come into question.
    That being said, I try to rate beer according to style. In other words, how good is it good according to Style?
    In explanation, a Budweiser will not rate as high as as many craft or import Lagers, any light lager will rate even lower as it is a very poor example of the style, it's beer so a 2.0- might be in order.
    There are styles that I don't quite understand, yet I will try to objectively rate such as Sours.
    The problem is occasionally I run up on a Farmhouse Saison, a style I really like and I think I rate these higher than they might deserve.
    It takes time and a good appreciation of the various styles to rate beer more accurately and objectively.
    I read the description and realize that some people rate with low numbers despite the fact they really like the beer.
    To my way of thinking all Craft Beer should rate near 4.0, otherwise it can't be very good.
    A few deserve a 4.5, I haven't had a 5.0 yet.
    Descriptions tell me more about a beer rating than a number.
    In any event it's supposed to be FUN.
    Cheers!
     
  17. PapaGoose03

    PapaGoose03 Grand High Pooh-Bah (6,057) May 30, 2005 Michigan
    BA4LYFE Society Pooh-Bah

    Subjectivity is a fluid thing and likely your's will change with additional experience, even in styles that you really like now. Keep on learning.

    For your learning purposes, I'll disagree with the bold section from your post. Budweiser (and all of the other macro lagers from the other macro brewers) is actually 'King' of that style, but so are most of the others. (It's really a logjam at the top.) Whether these beers fit into the Adjunct Lager, American Lager, Light Lager, Pale Lager or Pilsner style category, they are very well made beers and deserve a high score. Unfortunately, because they are light-flavored beers, many craft beer drinkers rate them downward because they perceive the lack of flavor means lack of quality. There's a place for these beers, and on a sweltering hot day when you're sweltering hot too, these beers hit the spot better than anything else short of ice water. The rest of the year, ehh.
     
  18. Junior

    Junior Pooh-Bah (1,883) May 23, 2015 Michigan
    Pooh-Bah Trader

    It’s awesome either way.
     
    PapaGoose03 and Tripel_Threat like this.
  19. rozzom

    rozzom Pooh-Bah (2,620) Jan 22, 2011 New York
    Pooh-Bah Trader

    I totally agree with this in theory. In practice though the logic would have to be tweaked to either exclude this concept from certain, popular styles, or to only give weighting not only to people who have had X+ number of beers from that style, but also have had X+ in at least Y other styles as well.

    I say this because giving extra weight to someone that's had 200+ saisons, or 200 dark milds (if that's even possible) makes sense. Giving the same weight to someone that's had 200+ NEIPAs...I dunno. Anecdotally I have seen reviews from certain haze-centric users seemingly range from:

    "Most disappointing NEIPA I've had from NEIPA-focused Brewery XYZ in the last two years - 4.25"

    to

    "Sex on the pallet - 5.00"
     
    Singlefinpin and Junior like this.
  20. Apathetiq

    Apathetiq Pundit (766) Sep 10, 2012 Massachusetts
    Trader

    I’m mainly concerned with the less popular styles continuing to be less popular because less experienced drinkers have equal weight.

    Hazie folks, well, if these two people think this beer is over 4.0, I’m at a loss[​IMG]
     
Thread Status:
Not open for further replies.