How does rarity affect your reviews?

Discussion in 'Beer Talk' started by ChanceK, Mar 11, 2012.

Thread Status:
Not open for further replies.
  1. fox227

    fox227 Initiate (0) Nov 19, 2010 California

    I don't think that rarity would affect most reviews. If a beer is highly rated already, you must ask yourself: what came first, the great beer or the great reviews for it? My guess is that it's probably a pretty good beer!
     
  2. aasher

    aasher Grand Pooh-Bah (4,557) Jan 27, 2010 Indiana
    Pooh-Bah

    This is a theory. Don't forget about homers :wink:
     
  3. xpimptastikx

    xpimptastikx Initiate (0) Oct 8, 2008 Texas

    Negatively now a days. I've had a lot of "rare" beers in the past 6 months that weren't that great. I also haven't been rating lately or much at all, but I've definitely not being seeking out "whales" recently with the exception of possibly 2.
     
  4. black13

    black13 Initiate (0) Apr 11, 2010 Oregon

    In general it doesn't. But if it were to affect my reviews in any way it would actually bring the scores down. When a beer is hyped/rated/drooled over it makes your expectation greater. So when I do taste one of these rare beers and it doesn't live up to it's hype, I'm let down. But since there is no category for "how did this beer live up your expectations" I just rate if for what it is, good, great, or bad.
     
  5. alfrantzell

    alfrantzell Initiate (0) Jul 11, 2005 California

    I'm more affected by Cantillonness. If a beer manifests traces of Cantillon or demonstrates sufficient Cantillonicity, I'll rate it. But I'm not biased toward products of Brasserie Cantillon; I give Cuvee des Champions only half a Cantillon. Schaerbeekse Kriek gets one and a half. Soleil de Minuit, on the other hand - three Cantillons.
     
    UCLABrewN84 likes this.
  6. Levitation

    Levitation Initiate (0) Aug 7, 2009 California

    i don't rate, don't care, but the top 100 has a lot of rare beers. so i think the conclusion is obvious.
     
  7. coreyfmcdonald

    coreyfmcdonald Initiate (0) Nov 13, 2008 Georgia

    There is really a lot going on with this.
    • Perception plays a big part in flavor. There is really not much you can do about this. Even if you taste blind, you are still perceiving things other than what you are rating.
    • As people said, if a beer is hard to get you tend to have higher expectations for it. This can positively or negatively affect reviews. Sometimes if you really want a beer to be good, it'll actually taste better to you. Sometimes, it could be such a disappointment that you rate it lower than it actually should be.
    • There is certainly brewery bias, particularly with sought after and local breweries. For example, it's tough to review a beer poorly if you know the brewer, subconsciously or otherwise. This is particularly true if it's a small batch one off beer in which he or she has a lot of pride.
    • Price certainly affects expectations on beer, similar to rarity or how hard a beer is to obtain.
    • You could also make the argument that rare beer in general is more of a craft than higher production beer. Make of this what you'd like.
     
  8. coreyfmcdonald

    coreyfmcdonald Initiate (0) Nov 13, 2008 Georgia

    I'm not sure this exactly proves a cause and effect relationship.
     
  9. jamescain

    jamescain Initiate (0) Jul 14, 2009 Texas

    Rarity's aroma and flavor can be subtle to very pronounced
     
  10. drewba

    drewba Pundit (847) Nov 14, 2009 Illinois

    Of course rarity affects reviews.

    figure 1.1: Splinter Black
    figure 1.2: Hellshire 1
     
    AleWatcher likes this.
  11. peteinSD

    peteinSD Initiate (0) Apr 25, 2010 California

    i cannot speak directly to the top 100 on this site as i do not look at it but i am very familiar with the top 100 on ratebeer.com and i suspect they are basically the same thing in terms of your comment. the ratebeer.com list certainly has many beers that are stupid rare - like, 34 rates and it's considered one of the best beers in the world rare. but if you pick through the list there are enough beers that are widely available and universally respected to allow the ranking system to retain some legitimacy.

    as to whether rarity impacts ratings for me personally i have to say that it does. it's really hard to be completely objective when you know the beer is highly rated, very hard to come by, and you'll never see it again. but it cuts both ways. a few years ago i traded for a darkness and I was dissapointed at the low quality of the beer in relation to its high ranking; same goes for kate the great. i think i ultimately rated both beers a bit lower than i should have because the substance didn't meet the hype.

    and this is why i really like "top beer" lists that have hundreds, if not thousands, of ratings for the beers on the list. you can really cut through a lot of the psychological bullshit when you're drawing from a sample of hundreds or thousands instead of a relative handful of mostly local ratings.
     
  12. MaxSpang

    MaxSpang Initiate (0) Jan 28, 2011 Ohio
    Trader

    Nothing tastes better than rarity.
     
  13. peteinSD

    peteinSD Initiate (0) Apr 25, 2010 California

    correct. there are beers that were once rare (e.g., angel's share) that are now common yet the beers retain the high level of rating (at least on ratebeer as far as angel's share goes).
     
  14. Levitation

    Levitation Initiate (0) Aug 7, 2009 California

    no, of course not. but it's the likeliest possibility when you take into context the wale-obsessed clownship culture of ba.

    agreed. i think the system prior to the current one (with an ever-increasing minimum review threshold to adjust for review database growth) was far better than the flat minimum of 10 or 20 or whatever it is now. right now, ratings are rarity-dominated. does that mean that rarity affects reviews, or does that mean that homers review highly because that's the second part of the equation to trading for wales (first part being low bottle count)? we'll never know for sure.
     
    AleWatcher likes this.
  15. peteinSD

    peteinSD Initiate (0) Apr 25, 2010 California

    you're right. i was just looking at the beers of fame list on this site, which i really like. sure, there may be a few beers in there that i do not like simply because of my personal tastes (choklat) but you'd be pretty hard pressed to argue that any of the beers on that list are not great beers you'd enjoy drinking.

    so the next question is whether beer geek nation is ready to mature and move to a consumer based rating system that focuses on 1,000s of ratings and consigns the "rarity" factor to a separate, sub-list of inferior validity? i think not.
     
  16. BobZ

    BobZ Savant (1,193) Jun 24, 2009 Massachusetts

    I try to do blind tastings with other beers to mute the rarity "inflation", such as Westy 12 with Pannepot, Rochefort 10, St. Bernardus Abt. 12, St. Amatus. That's also a good way for me to determine my favorite beers within a style.

    I think that helps, plus if I don't like a beer I'll pan it, I don't care how rare or highly "rated" it happens to be.
     
  17. BrianTheBrewer30

    BrianTheBrewer30 Initiate (0) Nov 17, 2009 Massachusetts

    How does rarity affect my reviews? It does not what so ever. I dont review and probably never will.
     
  18. Mkgrenwel

    Mkgrenwel Initiate (0) Sep 27, 2005 Maine

    If you think rarity doesn't affect reviews you don't know the first thing about psychology.

    I particularly have to laugh at the people that say "rarity doesn't have any impact on MY ratings." I do my best to be as objective as possible, as I think most of us do, but I'm also aware that this isn't something you can just will yourself into.

    It happens on both sites, but you can actually see it in action over on ratebeer (if you have a premium membership) with their graphs that show score over time. Compare KBS (significantly increased in rarity over time) to the aforementioned Angels Share (significantly decreased in rarity). I bet you can guess what the graphs look like without even looking.
     
  19. peteinSD

    peteinSD Initiate (0) Apr 25, 2010 California

    it's interesting because on ratebeer you can create your own customized top 50 beer list and one of the variables you can manipulate is number of ratings. here is how the cut-off of the number 50 beer changes according to number of ratings:

    600 ratings - 50th beer is Abbaye de Rocs Brune with a score of 4.06
    300 ratings - 50th beer is Lost Abbey Framboise de Amarosa with a score of 4.08
    150 ratings - 50th beer is older viscosity with a score of 4.09

    then when you view the regular top 50 list based on whatever forumla ratebeer uses you find that Goose Island Bourbon County Vanilla is the 50th beer with a score of 4.13.

    someone better with numbers than i can probably explain this better but it seems pretty straightforward that on an aggregate level scores are higher with a lower number of ratings. and for those not familiar with ratebeer.com, the difference between a 4.06 and 4.13 is quite large within the context of a beer being in the top 50.
     
  20. Levitation

    Levitation Initiate (0) Aug 7, 2009 California

    agreed.

    that's pretty neat. granted, both of those beers have other issues at play (qc issues / backlash with angel's share, and recipe change with kbs). but, like you, i'd bet rarity is the controlling factor. most ba's don't seem to know what they're tasting or how to evaluate it unless the bottle count is listed on the label.
     
Thread Status:
Not open for further replies.