How Have Your Ratings Changed Over Time?

Discussion in 'Beer Talk' started by Roguer, Nov 26, 2014.

Thread Status:
Not open for further replies.
  1. drtth

    drtth Initiate (0) Nov 25, 2007 Pennsylvania
    In Memoriam

    Yes, they have changed. Both the positive and the negative rDev have gotten smaller. I see this as a result my increased experience and improved internal standards against which to make my judgments, given that I deliberately avoid impuse buying and much more likely to be drinking beers from the "Beers of Fame" list than the "Top 250" list.
     
    Roguer likes this.
  2. bubseymour

    bubseymour Grand Pooh-Bah (4,800) Oct 30, 2010 Maryland
    Pooh-Bah Trader

    I'm actually opposite the OP. I tend to rate most beers higher than the avg. BA now adays than in years past. My theories:
    1) I'm more able to enjoy more styles and flavor profiles now than in the past with my beer drinking experience. I just love beer and most all beer styles now adays. Something really has to be "off" for me to give a beer below avg. rating. Beers that I thought were really bitter years ago now taste sweet and balanced. Sours are a flavor I crave now, but was a turnoff years ago. Beers that I would have rated a 2-3 years ago now may be in the 3.75-4.25 range.
    2) I'm a more experienced beer purchaser these days than my early years. I know how to check dates on bottles, don't buy beers sitting in the front window getting the UV rays etc. Many beers in my early years, I think were old and bad ones that I just didn't know so I gave lower reviews than most people who probably had them fresher.
    3) I have no bias, politics etc and don't care what other BAs think. I've give several adjuncts & BMC macros well over 4 ratings because I think they are excellent for the style and work for me.

    With that said, many of the really high rated beers I reviewed in early years (5's or near 5's), I've re-reviewed and dropped them down a little since I've had some better ones in same style more recently.
     
    TongoRad and Roguer like this.
  3. Roguer

    Roguer Grand High Pooh-Bah (7,811) Mar 25, 2013 Connecticut
    Mod Team Society Pooh-Bah Trader

    A couple interesting observations that complicate the exercise for some (but perhaps not specifically for me):

    1) Rating system changes. @yemenmocha and others pointed out the change in the Drinkability category, among others. Yes, that would make this a bit difficult - perhaps impossible, although I'm not 100% convinced - for one to look back at the past and apply those ratings in a present context.

    That's not an issue for me. We've had some ratings changes since I've joined, but the most significant was probably moving the target for 4.0 from "Good" to "Outstanding" (or whatever the exact terminology is). That may have had a slight impact on my scores, but not huge.

    2) More selective purchasing. @bubseymour and others mentioned this. One can still selectively look at ratings and account for this - say, look only within styles, or compare your trend in ratings just for beers on the Beers of Fame or Top 250 lists. But that would obviously be a ton of work.

    Again, not something that really applies to me, as I'm still trying tons of new beers, and new styles. Two days ago I tried Negra Modelo for the first time in my adult, beer-appreciating life. Good beer, and I gave it a decent rating - but if I were too selective in my choices, I never would have ordered it. There's still too much out there that I want to try.
     
    cavedave likes this.
  4. 57md

    57md Grand Pooh-Bah (3,033) Aug 22, 2011 Pennsylvania
    Pooh-Bah

    Since I got to about 100 beers rated, I've been periodically monitoring my rDev- particularly at the mean. My mean rDev has always been within +/- 1%. To me that is an acceptable variance.
     
  5. imhoudinibitch

    imhoudinibitch Initiate (0) Feb 6, 2014 New Jersey

    I no longer rate beers a 5 and I use the attribute rating system to vote
     
  6. UCLABrewN84

    UCLABrewN84 Initiate (0) Mar 18, 2010 California

    I think my ratings are generally under the average these days compared to the past.
     
  7. cavedave

    cavedave Grand Pooh-Bah (4,157) Mar 12, 2009 New York
    In Memoriam Pooh-Bah Trader

    I think having to judge beers at a few competitions has made me think of the importance of being really aware of what you are drinking, and that it really does have an impact, even for beers that are widely rated/reviewed, and that the folks who brew them are highly cognizant of what we think.

    My scores seem to have lowered over the years as I do this, but I feel more confident that I gave them an honest shot.
     
    #27 cavedave, Nov 28, 2014
    Last edited: Nov 28, 2014
    Roguer likes this.
  8. TheDoctor

    TheDoctor Grand Pooh-Bah (3,484) Mar 7, 2013 Canada (QC)
    Pooh-Bah Trader

    I've had some pretty shitty beers that were almost perfect in one way (say, appearance); but I have never had a GREAT beer that was perfect in every way.
     
    #28 TheDoctor, Nov 28, 2014
    Last edited: Nov 28, 2014
    polloenfuego likes this.
  9. Smakawhat

    Smakawhat Grand High Pooh-Bah (7,191) Mar 18, 2008 Maryland
    BA4LYFE Society Pooh-Bah

    I am not really sure...

    As I have had more beer my reviews have certainly grown more detailed. Kind of funny since my first review I ever did was barely three lines and not really informative.

    Still I find my overall feelings for a beer in the end don't change I just can say more about it.

    What I have discovered though is that if I find a beer really exceptional I can write more and say more about its character. That is when I know I am into something special.
     
  10. polloenfuego

    polloenfuego Pooh-Bah (2,346) Jan 26, 2013 Canada (NB)
    Pooh-Bah Trader

    Appearance is a sneaky one, isn't it? That initial draw after a beer is poured...

    So often I find it hard to knock a beer on that attribute.

    I realize that I have given out some higher ratings a little crazily. Early on, I think I was influenced by the hype, and now I feel much more confident in reviewing/rating a beer. I think there is a curve we all go through as we move along.

    Now, I realize that it is just as important to give "bad" beers proper reviews as it is good beers. As the Doctor alludes to, every beer has a redeeming quality.

    I expect the over more time, I will start to flat line. @TongoRad has the method I think I will follow...using the gradepoint average.
     
    TongoRad, TheDoctor and Roguer like this.
  11. TheDoctor

    TheDoctor Grand Pooh-Bah (3,484) Mar 7, 2013 Canada (QC)
    Pooh-Bah Trader

    Nail on the head. I think the 'answer' to this whole thread that is often glanced over is that everyone here is learning. This curve is like the proverbial 'learning curve.'

    Sure, people review/think about beer because it is fun, but at the end of the day reading about beer, thinking about it, drinking it, reviewing it, etc. is all practice.

    Naturally I would imagine most everyone has noticed this flat-lining as they gain a bigger base of experience to judge not only beer in general, but what makes individual beer either good or bad.
     
    Roguer likes this.
  12. Roguer

    Roguer Grand High Pooh-Bah (7,811) Mar 25, 2013 Connecticut
    Mod Team Society Pooh-Bah Trader

    Well, it's not exactly an overlooked 'answer;' rather, it's the exact point of the thread. But it's interesting to see different perspectives: people who tend to only review better beer (and hence higher ratings instead of lower, over time), or people who, over time, have come to rate things more to style (hence, Bud isn't a 1.0; it's a 4.5!).

    I would think that anyone with a few hundred reviews or more would experience a similar trend as I have, because of what you said above. But while that may be a common trend, it does not appear to be universal. Hence, my curiosity.
     
    TheDoctor likes this.
  13. ChrisWhoDrinksBeer

    ChrisWhoDrinksBeer Initiate (0) Nov 9, 2014 New York

    Would you believe that a group of academics actually studied and wrote a very well-received academic paper about this? When I say this, I mean precisely how users on BeerAdvocate change how they rate beers over time.

    In general, it seems that as users gain experience, they tend to rate the beers they like higher and the beers they dislike lower. They become more bimodal in their distribution of ratings. Also, they tend to like ales way more than lagers.

    It's a really interesting piece of work, though may be a bit technical. Check it out here: http://arxiv.org/pdf/1303.4402.pdf
    The title of the paper is "From amateurs to connoisseurs: modeling the evolution of user expertise through online reviews"
     
    TheDoctor and Roguer like this.
  14. Roguer

    Roguer Grand High Pooh-Bah (7,811) Mar 25, 2013 Connecticut
    Mod Team Society Pooh-Bah Trader

    That's really quite illuminating. An interesting caveat, though, by way of personal experience:

    My top 10 rated beers on BA are the usual suspects: DIPAs, Quads, a BBA Imperial Stout, a Tripel, and an IPA. These all fall under the blanket as the hoppiest, strongest, more extreme beers. Every single one of those ratings came within a year of my joining BA (loosely associated with the beginning of my journey through craft beer). The top 4 were all within 4 months of my joining: (2) DIPAs, a Quad, and a Tripel.

    My point: a novice palate I had, yet that didn't prevent me from rating beers rather high, even the hoppiest of the hoppy (of note: only 2 beers of my top 10 are in double-digit +rDevs, so it's not as though I was completely out to lunch on my ratings).

    That paper explores more or less the average ratings, and it is certainly true that hops are an acquired taste. However, I wonder if most people don't bother to get into the hoppiest of beers until they've acquired that taste. Moreover, an average or mean does not necessarily translate to the extremes. A novice might well be blown away by Heady Topper, and then subsequently underwhelmed by many "hoppy" brews, bringing the overall average in that category down, despite that one significant outlier.

    TL:grinning:R: I think that paper simplifies what may otherwise be a very complex interaction of averages vs outliers. Further, my own experience (by definition, perhaps, an outlier) does not really hold with its observations. But it's very cool and informative.
     
  15. mikepcarney

    mikepcarney Initiate (0) Oct 28, 2009 Ohio

    I have always given high rating to good to great beers and low ratings to moderate to bad beers. The longer I've been rating the closer I am to the norm.
     
Thread Status:
Not open for further replies.