1. The wait is over! Download the BeerAdvocate app on iTunes or Google Play now.
  2. Get 12 issues / year of BeerAdvocate magazine for only $9.99!

Comment Good BA rating, poor Bros rating

Discussion in 'Site' started by DCgolfpro, Jan 22, 2013.

Thread Status:
Not open for further replies.
  1. ChanChan

    ChanChan Advocate (555) California Dec 12, 2009

    These reviews are 10 years old, a lot of the hyped brews and breweries of today weren't even around yet!!
  2. Definitely correct. I learned how to pick apart beers and ID their flavors from reading more experienced reviewers. But there is a trap in looking too closely at the numerical score. For instance, I just tried heady topper, and while it is a damn fine beer, its not in my top 10, and it might not even be in the top 25 of beers ive tried.

    Some people will disagree with me and consider it the best beer in the world due to their personal preference, and some people will disagree with me because it is ranked as the best beer in the world
    jasonmason likes this.
  3. Todd

    Todd Founder (1,410) Colorado Aug 23, 1996 Staff Member

    Normally I'd agree, and we could pick any other user on the site and start a similar thread, however we're subject to more criticism as founders of the site and the fact that focus is being placed on our reviews/ratings both online and in the mag.
    BigCheese and Bitterbill like this.
  4. UncleJimbo

    UncleJimbo Site Editor (945) Massachusetts Sep 11, 2002 Staff Member

    Jason, please bring some Zombie Dust back for me when you get some. ;-)
  5. UncleJimbo

    UncleJimbo Site Editor (945) Massachusetts Sep 11, 2002 Staff Member

    There used to be a motto on this site: There are no beer experts, only beer drinkers.
    :cool:
    djl9701, chuckstout, AmitC and 5 others like this.
  6. I was trying to remember what the quote from the user (I believe it was Johnny P or something like that) that they had printed on the old shirts. Do you remember?
  7. UncleJimbo

    UncleJimbo Site Editor (945) Massachusetts Sep 11, 2002 Staff Member

    "Beer First, Everything Else Can Wait"
    Tballz420 and jasonmason like this.
  8. I saw this thread title and thought of Expedition right away. It had a 98 user rating and like a 76 Bros
    DCgolfpro likes this.
  9. Ah yeah, and the old pint in hand logo!
    Tballz420 likes this.
  10. I find the brothers reviews to be more consistent and correct that others that review here, also the brothers are more matter of fact when it seems like too many review so they can condemn a beer they don't like. If they review good and you review bad, it is more likely that you are wrong.
  11. Dirtinabottle

    Dirtinabottle Savant (385) New York Aug 21, 2012

    I come here for the good vibes and quality conversation about the beverage we all love so much. Whether or not you listen to the opinions of others or rely solely on your own palate, you usually heard it/read it here first. Its not a coincidence that when I get back from a taster or weekend of new beers, I log into BA and update my ratings and read reviews. Its a small part of the beer drinking experience for me but one I look forward to more and more often.
  12. slim2043

    slim2043 Savant (385) Connecticut Jul 23, 2012

    And on the shelf at my bottleshop.
  13. loafinaround

    loafinaround Savant (370) New York Jul 16, 2011

    ha, I just visited the publick house on sat! beer was good. food was too!
  14. I had AB Hurricane recently, and thought it was surprisingly decent besides some cardboard dryness.
  15. DCgolfpro

    DCgolfpro Savant (440) Maryland Oct 26, 2011

    Me....Obviously.
  16. I agree, however I never said that I review a beer solely on the basis of how it stands up to others within its category. I said that I consider it within that context. For me a "world class" beer is one that represents the best of its style as well as representing something (within the world of beer as a whole) that is exceptional.
  17. TheMonkfish

    TheMonkfish Initiate (0) Chad Jan 8, 2012

    As with all beer drinkers there are different palates and biases towards styles. There's also the factor that the editors are also trying to sell ad space (just like editors/publishers at newspapers/magazines who make copy decisions.) This is not Consumer Reports.
  18. UncleJimbo

    UncleJimbo Site Editor (945) Massachusetts Sep 11, 2002 Staff Member

    Are you saying The Bros. write good reviews to sell more ads in the magazine??
  19. broodog

    broodog Savant (325) Illinois Jul 18, 2009

    I think the brewer's full intention was to use the cheapest ingredients available, get the highest ABV, and market it to people who want to do nothing more than get shitfaced for the least amount of money possible. Just my two cents
  20. Blithering Idiot has a huge gap, 83-65
  21. Pabst Blue Ribbon 83 (Bro's) 69 (Not Bro's)
  22. TheMonkfish

    TheMonkfish Initiate (0) Chad Jan 8, 2012

    Nope, but unless you take a Consumer Reports model of ratings (taking zero advertising dollars) the editorial reviews will always be considered suspect to some users/subscribers. I'm not sure if there are any such "padded" ratings here on the site - I've long since stopped reading the editor ratings (and I only read users narrative ratings to see if any of them have picked up on beer facets that I have - chances are that they have not because I probably imagined them.)

    As, per the OP - much like the site owners, I know that I have some beer ratings that likely are way off from the street - that happens and I suspect that will happen with all aficionados of stuff like beer. Do I think that a horrible "site owners say" rating is indicative of someone who didn't buy a block of space? The answer is "not necessarily, and probably not."

    If it was Consumer Reports then I'd say "No".

    By the way, I think Consumer Reports thinks that DeWalt power tools are way better than they really are. ;)
  23. Jason

    Jason Founder (1,300) Massachusetts Aug 23, 1996 Staff Member

    Love when BAs integrity is questioned ... LOL.
    JG-90 likes this.
  24. JohnQVD

    JohnQVD Savant (365) New York Jan 23, 2011

    Some people just can't handle it when other people don't agree with them.
  25. Maybe they were rating it according to the style. A lot of reviews for certain beers are just stupid IMO. I.E. people that don't like sour beers rating them low because they don't like sours. If you cant judge a beer for what it is/supposed to be, maybe you shouldn't bother.
    MusicaleMike likes this.
  26. Doesn't that have a lot to do with putting your review in big font on the top of each page? No offense, but one doesn't become craft beer's Robert Parker without criticism.
  27. Todd

    Todd Founder (1,410) Colorado Aug 23, 1996 Staff Member

    If you reread my post, I'm pretty sure we're in agreement here ...
  28. Sam_Frank

    Sam_Frank Initiate (0) California Nov 29, 2012

    couldn't agree more. same goes for restaurant reviews, and why i can't stand Yelp most of the time. i hate when someone goes to a Mexican restaurant and does a review based on Nachos. or people going to meat-centric places but complaining about the lack of vegi options and giving a negative review. gfy
  29. Absolutely. I was just pointing out a specificity to your generality.... Damn semantics. :)
  30. LMT

    LMT Savant (305) Virginia Oct 15, 2009

    Smaller sample size with the Bros. vs. everyone else. They're bound to deviate from the average rating quite a bit every now & then.*

    *cue statistician to back me up here
  31. jgluck

    jgluck Aficionado (210) California Apr 19, 2012

    This is a common statistical concept and likely a valid contributing factor. And even when the Bros deviate from the average rating, the most extreme Bros' ratings are generally within one or two standard deviations from the community mean. (I know the math is trickier for skewed underlying distributions, but the general principle still roughly applies.)

    Another consideration is selection bias. Many of the anecdotal examples listed here are being selected from the extreme ends of the Bros' ratings. Out of the 955 beers currently rated by Todd, Todd's rating for Bell's Two Hearted Ale has the 38th most extreme negative deviation from the average community rating. The vast majority of Todd's ratings have minimal deviations from the community means - so what may seem like big discrepancies between BA and the Bros are likely normal outliers due to Todd reviewing many beers.

    Everyone has outliers in their reviews due to a variety of factors - such as old/off beers or subjective, personal influences. In fact, the top 38 of Todd's reviews with abnormally high negative deviations are all > 7 years old. This may or may not be a coincidence. On the other hand, it seems like Todd generally rated Flying Dog offerings lower than the community average. I personally love Raging Bitch (and most things Flying Dog), so there may or may not be a Flying Dog signature quality that polarizes opinions.

    Rather than single out the Bros' -- really, any BA user with 1,000 reviews would make an equally suitable example (and I hope Todd doesn't mind me using his data) -- I think a more fundamental, and interesting, question is:

    Do consensus reviews help converge on an "objective truth" (e.g. the Platonic Ideal, or The Wisdom of Crowds), do they follow flawed group-think, or do they do a bit of both? Better yet, do they help or hurt our beer journey and enjoyment?

    My personal opinion is pretty wishy-washy and boring. Reviews can be a mixed bag - useful, entertaining, educational, and misleading - so they should be valued for what they are and not canonized.

    ...except for Raging Bitch - that beer is unfairly way underrated.
    semaj, LMT and Premo88 like this.
  32. great post. i love math, gonzo imperial porter, and raging bitch.

    For non math people, across thousands of beers obviously the bros are gonna deviate from the average, all things considered their reviews are closer to the mean than I would expect. I think part of this is due to people reviewing a beer after they have read the bros (and others) review of the beer.

    If I were to review Westy 12 (havent had it) I highly doubt I would give it less than 4 in any category, just because of the precedent/hype.
  33. JG-90

    JG-90 Savant (380) New Jersey Nov 29, 2012

    So I am to pay no regard to what you say/review because your opinion is worth nothing in my mind :)
  34. Premo88

    Premo88 Savant (465) Texas Jun 6, 2010

    Reviews are one-shot views at a beer, and anybody who's tried hard to give a beer an honest shake knows that how a beer scores the first time might be different on a second or third shot. Right?

    Anyway, I pay more attention to the average rating than either the BA or Bros. grades. The Bros.' take is very important to me because, if nothing else, they know more about beer than I'll ever know. And I'll scan through a few reviews from the patrons just as a general gauge.

    Ultimately, though, what matters is what I think. I mean, if I like Bud Light Lime and you don't, so what?
  35. As far as AAL goes, Batch 19 and Schlitz Gusto both get consistently good reviews, though not great ones. And 'Gansett has lots of loyal fans who love the stuff. I understand Grain Belt does as well.
  36. dougfur

    dougfur Savant (310) New York Jan 24, 2011

    I think it also has to do with the inconsistant nature of beer, and of your palate. The same beer can taste really different depending on what you just ate, how thirsty you are, etc. And, I think even really good beers have inconsistancies between batches and even bottles. This gets ironed out over time with the public ratings, but there aren't enough bros. to do that!
Thread Status:
Not open for further replies.

Share This Page