Good BA rating, poor Bros rating

Talk Discussion in 'BeerAdvocate Talk' started by DCgolfpro, Jan 22, 2013.

Thread Status:
Not open for further replies.
  1. RaulMondesi

    RaulMondesi Grand Pooh-Bah (5,343) Dec 11, 2006 California
    Society Pooh-Bah Trader

    Pabst Blue Ribbon 83 (Bro's) 69 (Not Bro's)
     
  2. TheMonkfish

    TheMonkfish Initiate (0) Jan 8, 2012 Chad

    Nope, but unless you take a Consumer Reports model of ratings (taking zero advertising dollars) the editorial reviews will always be considered suspect to some users/subscribers. I'm not sure if there are any such "padded" ratings here on the site - I've long since stopped reading the editor ratings (and I only read users narrative ratings to see if any of them have picked up on beer facets that I have - chances are that they have not because I probably imagined them.)

    As, per the OP - much like the site owners, I know that I have some beer ratings that likely are way off from the street - that happens and I suspect that will happen with all aficionados of stuff like beer. Do I think that a horrible "site owners say" rating is indicative of someone who didn't buy a block of space? The answer is "not necessarily, and probably not."

    If it was Consumer Reports then I'd say "No".

    By the way, I think Consumer Reports thinks that DeWalt power tools are way better than they really are. :wink:
     
  3. UCLABrewN84

    UCLABrewN84 Initiate (0) Mar 18, 2010 California

  4. Jason

    Jason Founder (0) Aug 23, 1996 Massachusetts

    Love when BAs integrity is questioned ... LOL.
     
    JG-90 likes this.
  5. JohnQVD

    JohnQVD Pundit (875) Jan 23, 2011 New York

    Some people just can't handle it when other people don't agree with them.
     
  6. dortenzio1991

    dortenzio1991 Crusader (486) Aug 12, 2011 Connecticut

  7. PeterJ

    PeterJ Initiate (0) Dec 5, 2012 California

    Maybe they were rating it according to the style. A lot of reviews for certain beers are just stupid IMO. I.E. people that don't like sour beers rating them low because they don't like sours. If you cant judge a beer for what it is/supposed to be, maybe you shouldn't bother.
     
    MusicaleMike likes this.
  8. Ohsaycanyoubeer

    Ohsaycanyoubeer Initiate (0) Feb 8, 2012 Colorado

    Doesn't that have a lot to do with putting your review in big font on the top of each page? No offense, but one doesn't become craft beer's Robert Parker without criticism.
     
  9. PeterJ

    PeterJ Initiate (0) Dec 5, 2012 California

  10. Todd

    Todd Founder (13,518) Aug 23, 1996 Finland
    STAFF Mod Team Society Pooh-Bah

    If you reread my post, I'm pretty sure we're in agreement here ...
     
  11. Sam_Frank

    Sam_Frank Initiate (0) Nov 29, 2012 California

    couldn't agree more. same goes for restaurant reviews, and why i can't stand Yelp most of the time. i hate when someone goes to a Mexican restaurant and does a review based on Nachos. or people going to meat-centric places but complaining about the lack of vegi options and giving a negative review. gfy
     
  12. Ohsaycanyoubeer

    Ohsaycanyoubeer Initiate (0) Feb 8, 2012 Colorado

    Absolutely. I was just pointing out a specificity to your generality.... Damn semantics. :slight_smile:
     
  13. LMT

    LMT Initiate (0) Oct 15, 2009 Virginia

    Smaller sample size with the Bros. vs. everyone else. They're bound to deviate from the average rating quite a bit every now & then.*

    *cue statistician to back me up here
     
  14. jgluck

    jgluck Initiate (0) Apr 19, 2012 California

    This is a common statistical concept and likely a valid contributing factor. And even when the Bros deviate from the average rating, the most extreme Bros' ratings are generally within one or two standard deviations from the community mean. (I know the math is trickier for skewed underlying distributions, but the general principle still roughly applies.)

    Another consideration is selection bias. Many of the anecdotal examples listed here are being selected from the extreme ends of the Bros' ratings. Out of the 955 beers currently rated by Todd, Todd's rating for Bell's Two Hearted Ale has the 38th most extreme negative deviation from the average community rating. The vast majority of Todd's ratings have minimal deviations from the community means - so what may seem like big discrepancies between BA and the Bros are likely normal outliers due to Todd reviewing many beers.

    Everyone has outliers in their reviews due to a variety of factors - such as old/off beers or subjective, personal influences. In fact, the top 38 of Todd's reviews with abnormally high negative deviations are all > 7 years old. This may or may not be a coincidence. On the other hand, it seems like Todd generally rated Flying Dog offerings lower than the community average. I personally love Raging Bitch (and most things Flying Dog), so there may or may not be a Flying Dog signature quality that polarizes opinions.

    Rather than single out the Bros' -- really, any BA user with 1,000 reviews would make an equally suitable example (and I hope Todd doesn't mind me using his data) -- I think a more fundamental, and interesting, question is:

    Do consensus reviews help converge on an "objective truth" (e.g. the Platonic Ideal, or The Wisdom of Crowds), do they follow flawed group-think, or do they do a bit of both? Better yet, do they help or hurt our beer journey and enjoyment?

    My personal opinion is pretty wishy-washy and boring. Reviews can be a mixed bag - useful, entertaining, educational, and misleading - so they should be valued for what they are and not canonized.

    ...except for Raging Bitch - that beer is unfairly way underrated.
     
    semaj, LMT and Premo88 like this.
  15. BigCheese

    BigCheese Initiate (0) Jul 4, 2009 Massachusetts

    great post. i love math, gonzo imperial porter, and raging bitch.

    For non math people, across thousands of beers obviously the bros are gonna deviate from the average, all things considered their reviews are closer to the mean than I would expect. I think part of this is due to people reviewing a beer after they have read the bros (and others) review of the beer.

    If I were to review Westy 12 (havent had it) I highly doubt I would give it less than 4 in any category, just because of the precedent/hype.
     
  16. JG-90

    JG-90 Initiate (0) Nov 29, 2012 New Jersey

    So I am to pay no regard to what you say/review because your opinion is worth nothing in my mind :slight_smile:
     
  17. Premo88

    Premo88 Grand Pooh-Bah (3,682) Jun 6, 2010 Texas
    BA4LYFE Society Pooh-Bah

    Reviews are one-shot views at a beer, and anybody who's tried hard to give a beer an honest shake knows that how a beer scores the first time might be different on a second or third shot. Right?

    Anyway, I pay more attention to the average rating than either the BA or Bros. grades. The Bros.' take is very important to me because, if nothing else, they know more about beer than I'll ever know. And I'll scan through a few reviews from the patrons just as a general gauge.

    Ultimately, though, what matters is what I think. I mean, if I like Bud Light Lime and you don't, so what?
     
  18. mintjellie

    mintjellie Initiate (0) Oct 2, 2005 Canada (ON)

    As far as AAL goes, Batch 19 and Schlitz Gusto both get consistently good reviews, though not great ones. And 'Gansett has lots of loyal fans who love the stuff. I understand Grain Belt does as well.
     
  19. dougfur

    dougfur Initiate (0) Jan 24, 2011 New York

    I think it also has to do with the inconsistant nature of beer, and of your palate. The same beer can taste really different depending on what you just ate, how thirsty you are, etc. And, I think even really good beers have inconsistancies between batches and even bottles. This gets ironed out over time with the public ratings, but there aren't enough bros. to do that!
     
Thread Status:
Not open for further replies.