Ratings don't have to be subjective?

Discussion in 'Beer Talk' started by M-Fox24, Aug 26, 2015.

Thread Status:
Not open for further replies.
  1. M-Fox24

    M-Fox24 Grand Pooh-Bah (3,941) Mar 17, 2013 New Jersey
    Pooh-Bah Trader

    “In general, there are two approaches to critiquing beverages. A beer can be rated on a fundamental goodness scale, which communicates how much the reviewer liked the beer (aka "hedonistic" or "subjective"). On the other hand, a beer can be rated based upon how well it replicates its self-described style (aka objective)….” David Brockington (http://www.brewery.org/taproom/Rate.html)

    Point 1: An obscure example: Small Town Not Your Father’s Root Beer (5.9%)

    What warrants a 1 star rating vs. a 5 star rating; what factors are involved to bring this slowly down from a 5 to a 1?
    • Subjectively: it taste nothing like beer = 1+
    • Objectively: it is the definitive example of its style = 5-
    Now take the objective approach and start deducting points based on appearance, taste, and mouth-feel. Of course, this brew is controversial because of its style, and because of an absence in a strong presence of malt, yeast, barley, grains, hops, etc. So yes, if one is reviewing the beer based on what beer taste like then one's rating will be far from a 5. If one is reviewing the beer based on its “self-described style” then one will be far from a 1. I’m not saying or trying to pick a fight with those who classify this as a 5 or a 1, for one thing “fruit/spiced/vegetable” beers are amongst the most controversial beers to review (IMO). Take NG Fruits for example, one may not like Jolly Ranchers dominating the palate. However, one should take note of the tartness, the variety of berries, and the overall intricacy.

    Point #2: The other thing to consider is the expectations of both the brewer and drinker:

    “Culinary beers that are meant to taste exactly like something are not where our interest are. If we make a beer with dandelions, it won’t be 100 pounds of them. We’re trying to take some floral character from the botanicals, but we never try to be heavy handed about it….” Nathan Zeender/Right Proper (Issue #101, Pg. 38).

    First and foremost, Right Proper makes excellent beer. Now, to me Mr. Nathan would never make a “Not Your Father’s Root Beer” type beer. Not because of its style, but because it’s not in the brewers interest to make a beer that taste exactly what its inclined to taste like (nothing wrong with that). So, here’s the predicament, here’s where subjectivity kicks in, and here’s where the drinker becomes perplexed: Should one rate a beer based on the style, the expectation of the brewer, or the expectation of oneself?

    Closing Thoughts:
    • I could have just started this thread with the quote above, left out all the rubbish in between, and ended with “stop whining about beer being subjective.” But, there seems to be no clear-cut answer; in some cases (perhaps many), beer is subjective
    • Ratings of 1 should not be reviewed here or anywhere, as I strongly side with David Brockington in that: “I reserve scores lower than two stars for beers for which I should not have paid money. In all cases, the type of the flaw (infection, making it a brewery issue, or oxidation etc., making it an issue out of the hands of the brewery) will be noted.”
      • Henceforth, if the beer is infected, handled improperly, or out of the hands of the brewery then don’t review it/right? Hopefully, those who choose to review do so for good reason, and do so in the most objectively way possible (e.g. no 5-Start rating based on the hype, or some other bias foreground).




    ****A 5-star is warranted when it is “a world classic either because it has outstanding complexity and distinction or because it is the definitive example of its style, and no matter whether everyone is capable of appreciating it; some people probably don’t like first-growth Bordeaux, either…” Michael Jackson’s first Pocket Guide to Beer
     
    #1 M-Fox24, Aug 26, 2015
    Last edited: Aug 26, 2015
  2. mstrcrwly

    mstrcrwly Pundit (912) Dec 21, 2013 New York
    Trader

    Anything based on a person's opinion or taste is subjective..no matter what..food,beer,music,movies,etc..what one person loves another may not like and vice versa...some people think Bud is the be all end all of beer..who is anyone to tell them otherwise? If they choose to believe that..more power to 'em..Just leaves more great beer for the rest of us.
     
  3. Pantalones

    Pantalones Initiate (0) Nov 14, 2014 Virginia

    It's probably pretty much impossible to be truly "objective" when it comes to something as subjective as taste -- one person's taste buds literally do not pick up things the same way as another person's. Same with noses and smell.

    That said, it's definitely possible to be a little more objective than the "I don't like adjunct lagers/light lagers so I give them all straight 1s, maybe a 2 or 3 in appearance just to make it look like I'm not giving it straight 1s" kind of reviews... or alternatively, on the other end of the spectrum, "I really liked this beer so I gave it straight 5s." More to do with actually putting some thought/effort into it rather than trying to be objective, though the thought/effort put in (rather than just rushing to slap 1s on things you didn't like and 5s on things you did) generally ends up making the resulting review more objective in the end anyway.
     
  4. Fox82791

    Fox82791 Initiate (0) Jun 20, 2014 New York

    Interesting point. When I rate and/or review beers I try to consider both my enjoyment and how it follows the style. If it's clearly a beer meant to skirt the lines of different styles or just be very unique, I'll go by enjoyment.
     
    frozen-1984 likes this.
  5. Scott17Taylor

    Scott17Taylor Initiate (0) Oct 28, 2013 Iowa
    Trader

    Taste is always subjective.
     
    rgordon, DaverCS and ECdOc like this.
  6. drtth

    drtth Initiate (0) Nov 25, 2007 Pennsylvania
    In Memoriam

    Taste is subjective but can be made objective.
     
  7. Mark-Leggett

    Mark-Leggett Pooh-Bah (2,317) Jul 30, 2014 Missouri
    Pooh-Bah

    I think you have to take into account the style, a mix of objective and subjective. I have seen people review an ipa and rate it low and say I just dont like ipa's. If you dont like the style please dont rate or review it and say its awful
     
  8. ECdOc

    ECdOc Initiate (0) Nov 9, 2004 Pennsylvania

    While I rate most of my beers on Untappd, my rating system on there (and everyone should have one) goes like this:
    5- Will seek out this beer
    4- Will recommend this beer to other people to try
    3- Good beer but not good enough to recommend
    2- This beer I do not like, but you might
    1- I would recommend against trying this beer
    no rating - Either I thought something was wrong with the packaging or lines from a draft line,the beer is old, or other anomaly that I'm not blaming the beer for.

    I find having my ratings actually mean something to me tends to keep them sane, and the partial points in between go to show how far i am leaning from one stage to another. Now, these ratings are only really relevant to me and my tastes but they do help me remember which beer I liked or did not like when I go to get a pint. So, at least for me ratings are only relevant to me and whether I liked or would recommend the beer for someone else to try. I'd never try to rate something for everyone's taste since it's so subjective and not very possible IMO. Interesting discussion, but I'm not a fan of "style" in general. That's a whole other can of worms.
     
  9. fredmugs

    fredmugs Initiate (0) Aug 11, 2012 Indiana

    4 = I would buy this again.
    3 = Meh but I don't dislike it.

    Everything derives from that.
     
  10. sjverla

    sjverla Initiate (0) Dec 1, 2008 Massachusetts

    Even if you're rating against the the 'self-described style' there's a high level of subjectivity that comes into play. For some styles there's a veritable canon of benchmarks. For example, does a new Belgian Dark Strong Ale/Quad taste more similar to Abt 12 or Westy? If it's closer to Abt 12, is it somehow 'less than'? Because, at least anecdotally, there's a large contingent that claims Westy 12 is essentially the best beer in the world. You can say, with reasonable objectivity, if that beer hits the general hallmarks of the style (color, ABV, gravity specs, IBUs, even general flavor profiles), but if it does, does that make it subjectively taste good? Presumably, if you nail every aspect of a style, you'll have a good beer, but I think that is by no means a guarantee. I know this for a fact because I personally have made beers that fit the BJCP's criteria for a given style and ultimately found them underwhelming. Did I objectively make a pale ale? Yes! But that doesn't mean much of anything.

    And the other issue is that this canon is being constructed based on criteria that are ultimately recorded through subjective means. Abt 12 and Westy 12 are so highly regarded because they taste great, and have come to be representative of the style for that reason. They did not necessarily define the style.

    To keep ratings useful, rating to style is critical, but there's no way it will ever be truly objective.
     
    azorie, utopiajane and ThickNStout like this.
  11. PapaGoose03

    PapaGoose03 Grand High Pooh-Bah (6,057) May 30, 2005 Michigan
    BA4LYFE Society Pooh-Bah

    Except for the very basic evaluation of a beer, there is a mixture of subjectivity and objectivity in every rating.

    Basic 100% subjectivity: "Ehh, I don't like it." vs. "Oh man, I love this beer."

    Introduce a reason for why you like or don't like that beer ("I like this beer because it has a great hop flavor combination.") and you've started the objective part of the process getting into your rating. The more evaluation points for that beer, then the more objective the evaluation becomes. True, each point in the objective process is subjective, but each subjective point can be further broken down into an objective form. ("I think the hop flavor rates a 9 out of 10.")

    Objectivity and subjectivity are inseparable above the basic level of evaluation.
     
    utopiajane likes this.
  12. THANAT0PSIS

    THANAT0PSIS Pooh-Bah (2,275) Aug 3, 2010 Wisconsin
    Pooh-Bah

    How many times are we going to repackage this thread topic under a thin-yet-shiny new covering?

    I'll try to be short and succinct since I've stated my opinion on this issue many, many times, always long-windedly: If you can't be bothered to review with some modicum of objectivity, don't review. Reviews that don't take style and objectivity into account are completely useless and should not be allowed on this site, period.

    I understand this comes off a lot less level-headed than I may have been in the past, but it irks me beyond belief that people simply can't set their personal biases a few inches to the side and attempt to give a thoughtful opinion backed up by facts within an established rubric. It's not hard. If you want to be totally subjective and hedonistic, do it in a place that doesn't have the motto "Respect beer." Go to Untappd.

    Edit: To be clear, I'm not saying you should or need to rate 100% objectively; that's not possible. I'm saying everyone should rate with some percentage of objectivity. I advocate for at least 50%, ideally around 60-65% in favor of objectivity. That means your opinion still counts, but does not dominate the rating.

    Also, while rating to style is important, I think that a lot of brewers these days, particularly in the US, are trying to break out of styles or put their own twist on styles. To make sure one doesn't unfairly fault them for experimentation (a key component to keeping things fresh and pushing beer as a whole forward), one should rate against what the brewer set out to do as well as the style the beer is closest to/bills itself as.
     
    #12 THANAT0PSIS, Aug 26, 2015
    Last edited: Aug 26, 2015
    Hendrick24, azorie, Roguer and 4 others like this.
  13. DaverCS

    DaverCS Savant (1,212) Dec 9, 2014 Arizona

    Objectivity is 100 percent quantifiable without dispute. How do you accurately quantify the quality of color, taste, mouth-feel or aroma without dispute? If this was possible, all ratings would be relatively the same, but they're not because everyone subjectively views beers differently. By using the BA rating system, you are applying an objective scaling system to your subjective opinions.
     
    BSW likes this.
  14. charlzm

    charlzm Initiate (0) Sep 3, 2007 California

    Exactly 6301 more times.
     
    TwoTrees likes this.
  15. TheMagnanimous

    TheMagnanimous Initiate (0) Mar 16, 2011 Vermont

    Here's the problem with that example - there's a strong argument that NYFRB is simply not beer at all. Michael Tonsmiere tweeted about this - it has a FG in the 1.052 which would only make sense starting with an absurd gravity meant for like a 15% stout. They would be losing tons of money. https://twitter.com/MadFermentation/status/626531815222845440

    Essentially they backsweeten, like a Mike's Hard. It's vodka with root beer spices, and has a ton of sugar. NYFRB is the "definitive style" of nothing, and will probably give you diabetes like soda does.
     
    mudbug and THANAT0PSIS like this.
  16. Hoppsbabo

    Hoppsbabo Pooh-Bah (2,053) Jan 29, 2012 England
    Pooh-Bah

    'On the other hand, a beer can be rated based upon how well it replicates its self-described style (aka objective)….'

    Styles are very subjective and rating to style is utter bollocks!
     
    marquis likes this.
  17. THANAT0PSIS

    THANAT0PSIS Pooh-Bah (2,275) Aug 3, 2010 Wisconsin
    Pooh-Bah

    I never understood this. Beer doesn't really have a singular taste. When I hear someone say, "This tastes like beer," it makes me think of an AAL taste and is usually used demeaningly. To dock something because it doesn't taste "like beer" is absurd. Lambics probably don't taste like "beer" to most people, should we dock them for that?

    Still, NYFRB is hardly a beer for reasons mentioned referring to its composition. That is what makes is difficult or impossible to review for this site. It is not beer. If we include it, we should include Zima, Mike's Hard, etc.[/QUOTE]
     
    BourbonJersey and mudbug like this.
  18. 57md

    57md Grand Pooh-Bah (3,033) Aug 22, 2011 Pennsylvania
    Pooh-Bah

    A critic who demands the establishment of "objective" standards simply wants everyone to rate beer according to his/her subjective standards.
     
    gibgink, TMoney2591 and Kman_Colorado like this.
  19. utopiajane

    utopiajane Grand Pooh-Bah (3,982) Jun 11, 2013 New York
    Pooh-Bah

    Both the review and the idea of taste are inherently subjective. As far as scoring a beer it's the best approach to use the style as your guide and then appreciate the beer from there. That will tell you as much about whether the brewer is successful in either making a style well or in putting a unique twist on a beer form the approach of both style and taste. Recently I had a beer that I did not like. I orginally rated int around a 3. Then after I really drank it some more and thought about it, I increased the score to around a 3.5. Inching it up by the categories as I came up with reasons why it was a better beer than the score I gave it even though I did not like it. This is also why really drinking more than one of a beer is a great way to examine it closely.
     
    TwoTrees, superspak and THANAT0PSIS like this.
  20. M-Fox24

    M-Fox24 Grand Pooh-Bah (3,941) Mar 17, 2013 New Jersey
    Pooh-Bah Trader


    Every topic is a recycled product of something; I want folks to view it in a different light (e.g. fruit/vegetable/spice beer).

    NYFR is on this site, and is rated on this site, so I choose it. Whether or not it’s a beer…Well, that’s a topic for another recycled thread. Nonetheless, I suppose I could have chosen:
    • NG Apple Ale, Raspberry Tart
    • Carton Regular Coffee, Orange Swisher
    • Forgotten Boardwalk Funnel Cake
    • Short’s Strawberry Short’s Cake
    • Etc……
    In any regard, there will always be a problem with whatever criteria is chosen, but as THANAT0PSIS pinpointed; “If you can't be bothered to review with some modicum of objectivity, don't review.”

    The considerations in reviewing a beer before bashing it, or praising it, are indeed subjective. The objective approach is one’s combination of their expressive and methodical context….along with an assortment of other criteria


    “I want folks to view it in a different light…” I realize I highlighted fruit beer, but the thread is meant to cover more than one area
     
Thread Status:
Not open for further replies.