Dismiss Notice
Curious about recent updates to the site and app? Check the Announcements forum for updates.
Dismiss Notice
Love Belgian Beer?

Join us Sep 17 in Portland, Maine for Return of the Belgian Beer Fest, featuring hundreds of authentic Belgian beers and Belgian-inspired offerings.

Tickets + more: beeradvocate.com/belgian

Comment Good BA rating, poor Bros rating

Discussion in 'Feedback' started by DCgolfpro, Jan 22, 2013.

Thread Status:
Not open for further replies.
  1. ChanChan

    Beer Trader

    Joined:
    Dec 12, 2009
    Posts:
    1,253
    Likes Received:
    1,836
    Location:
    California
    These reviews are 10 years old, a lot of the hyped brews and breweries of today weren't even around yet!!
     
  2. Tballz420

    Joined:
    Mar 4, 2003
    Posts:
    237
    Likes Received:
    615
    Location:
    Minnesota
    Definitely correct. I learned how to pick apart beers and ID their flavors from reading more experienced reviewers. But there is a trap in looking too closely at the numerical score. For instance, I just tried heady topper, and while it is a damn fine beer, its not in my top 10, and it might not even be in the top 25 of beers ive tried.

    Some people will disagree with me and consider it the best beer in the world due to their personal preference, and some people will disagree with me because it is ranked as the best beer in the world
     
    jasonmason likes this.
  3. Todd

    Todd Founder
    Staff Member Fest Crew Subscriber

    Joined:
    Aug 23, 1996
    Posts:
    6,983
    Likes Received:
    17,745
    Location:
    Colorado
    Normally I'd agree, and we could pick any other user on the site and start a similar thread, however we're subject to more criticism as founders of the site and the fact that focus is being placed on our reviews/ratings both online and in the mag.
     
    BigCheese and Bitterbill like this.
  4. UncleJimbo

    UncleJimbo Site Editor
    Staff Member Subscriber Beer Trader

    Joined:
    Sep 11, 2002
    Posts:
    664
    Likes Received:
    268
    Location:
    Massachusetts
    Jason, please bring some Zombie Dust back for me when you get some. ;-)
     
  5. UncleJimbo

    UncleJimbo Site Editor
    Staff Member Subscriber Beer Trader

    Joined:
    Sep 11, 2002
    Posts:
    664
    Likes Received:
    268
    Location:
    Massachusetts
    There used to be a motto on this site: There are no beer experts, only beer drinkers.
    :cool:
     
    djl9701, chuckstout, AmitC and 5 others like this.
  6. Tballz420

    Joined:
    Mar 4, 2003
    Posts:
    237
    Likes Received:
    615
    Location:
    Minnesota
    I was trying to remember what the quote from the user (I believe it was Johnny P or something like that) that they had printed on the old shirts. Do you remember?
     
  7. UncleJimbo

    UncleJimbo Site Editor
    Staff Member Subscriber Beer Trader

    Joined:
    Sep 11, 2002
    Posts:
    664
    Likes Received:
    268
    Location:
    Massachusetts
    "Beer First, Everything Else Can Wait"
     
    Tballz420 and jasonmason like this.
  8. HipsterBrewfus

    Joined:
    Jun 3, 2012
    Posts:
    457
    Likes Received:
    416
    Location:
    Maryland
    I saw this thread title and thought of Expedition right away. It had a 98 user rating and like a 76 Bros
     
    DCgolfpro likes this.
  9. jasonmason

    Joined:
    Oct 6, 2004
    Posts:
    166
    Likes Received:
    276
    Location:
    California
    Ah yeah, and the old pint in hand logo!
     
    Tballz420 likes this.
  10. SlickRick

    Joined:
    Jun 4, 2005
    Posts:
    12
    Likes Received:
    4
    Location:
    Georgia
    I find the brothers reviews to be more consistent and correct that others that review here, also the brothers are more matter of fact when it seems like too many review so they can condemn a beer they don't like. If they review good and you review bad, it is more likely that you are wrong.
     
  11. Dirtinabottle

    Beer Trader

    Joined:
    Aug 21, 2012
    Posts:
    140
    Likes Received:
    143
    Location:
    New York
    I come here for the good vibes and quality conversation about the beverage we all love so much. Whether or not you listen to the opinions of others or rely solely on your own palate, you usually heard it/read it here first. Its not a coincidence that when I get back from a taster or weekend of new beers, I log into BA and update my ratings and read reviews. Its a small part of the beer drinking experience for me but one I look forward to more and more often.
     
  12. slim2043

    Joined:
    Jul 23, 2012
    Posts:
    180
    Likes Received:
    295
    Location:
    Connecticut
    And on the shelf at my bottleshop.
     
  13. loafinaround

    Joined:
    Jul 16, 2011
    Posts:
    1,465
    Likes Received:
    2,185
    Location:
    New York
    ha, I just visited the publick house on sat! beer was good. food was too!
     
  14. Stinkypuss

    Joined:
    Apr 7, 2008
    Posts:
    472
    Likes Received:
    504
    Location:
    Pennsylvania
    I had AB Hurricane recently, and thought it was surprisingly decent besides some cardboard dryness.
     
  15. DCgolfpro

    Beer Trader

    Joined:
    Oct 26, 2011
    Posts:
    539
    Likes Received:
    517
    Location:
    Maryland
    Me....Obviously.
     
  16. Brandywine

    Joined:
    Aug 20, 2012
    Posts:
    99
    Likes Received:
    65
    Location:
    Washington
    I agree, however I never said that I review a beer solely on the basis of how it stands up to others within its category. I said that I consider it within that context. For me a "world class" beer is one that represents the best of its style as well as representing something (within the world of beer as a whole) that is exceptional.
     
  17. TheMonkfish

    Joined:
    Jan 8, 2012
    Posts:
    880
    Likes Received:
    580
    Location:
    Chad
    As with all beer drinkers there are different palates and biases towards styles. There's also the factor that the editors are also trying to sell ad space (just like editors/publishers at newspapers/magazines who make copy decisions.) This is not Consumer Reports.
     
  18. UncleJimbo

    UncleJimbo Site Editor
    Staff Member Subscriber Beer Trader

    Joined:
    Sep 11, 2002
    Posts:
    664
    Likes Received:
    268
    Location:
    Massachusetts
    Are you saying The Bros. write good reviews to sell more ads in the magazine??
     
  19. broodog

    Joined:
    Jul 18, 2009
    Posts:
    286
    Likes Received:
    926
    Location:
    Illinois
    I think the brewer's full intention was to use the cheapest ingredients available, get the highest ABV, and market it to people who want to do nothing more than get shitfaced for the least amount of money possible. Just my two cents
     
  20. bobbanks001

    Beer Trader

    Joined:
    Sep 14, 2012
    Posts:
    30
    Likes Received:
    121
    Location:
    Pennsylvania
    Blithering Idiot has a huge gap, 83-65
     
  21. RaulMondesi

    Joined:
    Dec 11, 2006
    Posts:
    972
    Likes Received:
    4,514
    Location:
    California
    Pabst Blue Ribbon 83 (Bro's) 69 (Not Bro's)
     
  22. TheMonkfish

    Joined:
    Jan 8, 2012
    Posts:
    880
    Likes Received:
    580
    Location:
    Chad
    Nope, but unless you take a Consumer Reports model of ratings (taking zero advertising dollars) the editorial reviews will always be considered suspect to some users/subscribers. I'm not sure if there are any such "padded" ratings here on the site - I've long since stopped reading the editor ratings (and I only read users narrative ratings to see if any of them have picked up on beer facets that I have - chances are that they have not because I probably imagined them.)

    As, per the OP - much like the site owners, I know that I have some beer ratings that likely are way off from the street - that happens and I suspect that will happen with all aficionados of stuff like beer. Do I think that a horrible "site owners say" rating is indicative of someone who didn't buy a block of space? The answer is "not necessarily, and probably not."

    If it was Consumer Reports then I'd say "No".

    By the way, I think Consumer Reports thinks that DeWalt power tools are way better than they really are. ;)
     
  23. UCLABrewN84

    Joined:
    Mar 18, 2010
    Posts:
    7,934
    Likes Received:
    7,933
    Location:
    California
  24. Jason

    Jason Founder
    Staff Member Fest Crew Subscriber

    Joined:
    Aug 23, 1996
    Posts:
    2,911
    Likes Received:
    6,663
    Location:
    Massachusetts
    Love when BAs integrity is questioned ... LOL.
     
    JG-90 likes this.
  25. JohnQVD

    Joined:
    Jan 23, 2011
    Posts:
    154
    Likes Received:
    71
    Location:
    New York
    Some people just can't handle it when other people don't agree with them.
     
  26. dortenzio1991

    Beer Trader

    Joined:
    Aug 12, 2011
    Posts:
    423
    Likes Received:
    331
    Location:
    Connecticut
  27. PeterJ

    Joined:
    Dec 5, 2012
    Posts:
    318
    Likes Received:
    209
    Location:
    California
    Maybe they were rating it according to the style. A lot of reviews for certain beers are just stupid IMO. I.E. people that don't like sour beers rating them low because they don't like sours. If you cant judge a beer for what it is/supposed to be, maybe you shouldn't bother.
     
    MusicaleMike likes this.
  28. Ohsaycanyoubeer

    Joined:
    Feb 8, 2012
    Posts:
    219
    Likes Received:
    122
    Location:
    Colorado
    Doesn't that have a lot to do with putting your review in big font on the top of each page? No offense, but one doesn't become craft beer's Robert Parker without criticism.
     
  29. wesbray

    Beer Trader

    Joined:
    Feb 29, 2012
    Posts:
    1,370
    Likes Received:
    1,933
    Location:
    Alberta (Canada)
  30. PeterJ

    Joined:
    Dec 5, 2012
    Posts:
    318
    Likes Received:
    209
    Location:
    California
  31. Todd

    Todd Founder
    Staff Member Fest Crew Subscriber

    Joined:
    Aug 23, 1996
    Posts:
    6,983
    Likes Received:
    17,745
    Location:
    Colorado
    If you reread my post, I'm pretty sure we're in agreement here ...
     
  32. Sam_Frank

    Joined:
    Nov 29, 2012
    Posts:
    673
    Likes Received:
    1,697
    Location:
    California
    couldn't agree more. same goes for restaurant reviews, and why i can't stand Yelp most of the time. i hate when someone goes to a Mexican restaurant and does a review based on Nachos. or people going to meat-centric places but complaining about the lack of vegi options and giving a negative review. gfy
     
  33. Ohsaycanyoubeer

    Joined:
    Feb 8, 2012
    Posts:
    219
    Likes Received:
    122
    Location:
    Colorado
    Absolutely. I was just pointing out a specificity to your generality.... Damn semantics. :)
     
  34. LMT

    LMT

    Joined:
    Oct 15, 2009
    Posts:
    962
    Likes Received:
    2,150
    Location:
    Virginia
    Smaller sample size with the Bros. vs. everyone else. They're bound to deviate from the average rating quite a bit every now & then.*

    *cue statistician to back me up here
     
  35. jgluck

    Joined:
    Apr 19, 2012
    Posts:
    35
    Likes Received:
    30
    Location:
    California
    This is a common statistical concept and likely a valid contributing factor. And even when the Bros deviate from the average rating, the most extreme Bros' ratings are generally within one or two standard deviations from the community mean. (I know the math is trickier for skewed underlying distributions, but the general principle still roughly applies.)

    Another consideration is selection bias. Many of the anecdotal examples listed here are being selected from the extreme ends of the Bros' ratings. Out of the 955 beers currently rated by Todd, Todd's rating for Bell's Two Hearted Ale has the 38th most extreme negative deviation from the average community rating. The vast majority of Todd's ratings have minimal deviations from the community means - so what may seem like big discrepancies between BA and the Bros are likely normal outliers due to Todd reviewing many beers.

    Everyone has outliers in their reviews due to a variety of factors - such as old/off beers or subjective, personal influences. In fact, the top 38 of Todd's reviews with abnormally high negative deviations are all > 7 years old. This may or may not be a coincidence. On the other hand, it seems like Todd generally rated Flying Dog offerings lower than the community average. I personally love Raging Bitch (and most things Flying Dog), so there may or may not be a Flying Dog signature quality that polarizes opinions.

    Rather than single out the Bros' -- really, any BA user with 1,000 reviews would make an equally suitable example (and I hope Todd doesn't mind me using his data) -- I think a more fundamental, and interesting, question is:

    Do consensus reviews help converge on an "objective truth" (e.g. the Platonic Ideal, or The Wisdom of Crowds), do they follow flawed group-think, or do they do a bit of both? Better yet, do they help or hurt our beer journey and enjoyment?

    My personal opinion is pretty wishy-washy and boring. Reviews can be a mixed bag - useful, entertaining, educational, and misleading - so they should be valued for what they are and not canonized.

    ...except for Raging Bitch - that beer is unfairly way underrated.
     
    semaj, LMT and Premo88 like this.
  36. BigCheese

    Joined:
    Jul 4, 2009
    Posts:
    800
    Likes Received:
    669
    Location:
    Massachusetts
    great post. i love math, gonzo imperial porter, and raging bitch.

    For non math people, across thousands of beers obviously the bros are gonna deviate from the average, all things considered their reviews are closer to the mean than I would expect. I think part of this is due to people reviewing a beer after they have read the bros (and others) review of the beer.

    If I were to review Westy 12 (havent had it) I highly doubt I would give it less than 4 in any category, just because of the precedent/hype.
     
  37. JG-90

    Joined:
    Nov 29, 2012
    Posts:
    234
    Likes Received:
    720
    Location:
    New Jersey
    So I am to pay no regard to what you say/review because your opinion is worth nothing in my mind :)
     
  38. Premo88

    Joined:
    Jun 6, 2010
    Posts:
    1,635
    Likes Received:
    12,665
    Location:
    Texas
    Reviews are one-shot views at a beer, and anybody who's tried hard to give a beer an honest shake knows that how a beer scores the first time might be different on a second or third shot. Right?

    Anyway, I pay more attention to the average rating than either the BA or Bros. grades. The Bros.' take is very important to me because, if nothing else, they know more about beer than I'll ever know. And I'll scan through a few reviews from the patrons just as a general gauge.

    Ultimately, though, what matters is what I think. I mean, if I like Bud Light Lime and you don't, so what?
     
  39. mintjellie

    Joined:
    Oct 2, 2005
    Posts:
    387
    Likes Received:
    158
    Location:
    Ontario (Canada)
    As far as AAL goes, Batch 19 and Schlitz Gusto both get consistently good reviews, though not great ones. And 'Gansett has lots of loyal fans who love the stuff. I understand Grain Belt does as well.
     
  40. dougfur

    Joined:
    Jan 24, 2011
    Posts:
    386
    Likes Received:
    280
    Location:
    New York
    I think it also has to do with the inconsistant nature of beer, and of your palate. The same beer can taste really different depending on what you just ate, how thirsty you are, etc. And, I think even really good beers have inconsistancies between batches and even bottles. This gets ironed out over time with the public ratings, but there aren't enough bros. to do that!
     
Thread Status:
Not open for further replies.
  • About Us

    Your go-to website for beer (since 1996), publishers of BeerAdvocate magazine (since 2006) and hosts of world-class beer events (since 2003). Respect Beer.
  • Return of the Belgian Beer Fest

    BeerAdvocate Brings its All-Belgian Fest to Portland, Maine on September 17, 2016. Tickets are on sale now.

    Learn More
  • Get the Mag

    Become a BeerAdvocate magazine print subscriber today.

    Subscribe