New Stat: User's Average Score?

Talk Discussion in 'BeerAdvocate Talk' started by Gutes_Bier, Jul 2, 2013.

Thread Status:
Not open for further replies.
  1. Gutes_Bier

    Gutes_Bier Maven (1,363) Jul 31, 2011 Germany

    I was wondering what everyone's thoughts might be on a stat for User's Average Score (sorry if this has been discussed already, I gave a quick look and didn't see it). Very simply, total points awarded divided by total beers reviewed. I realize it's a very broad stat, but there are two ideas at work:
    • Comparative: simply to see if perhaps Person A tends to grade higher/lower than Person B.
    • Self assessment. Are my scores are in line with my grading philosophy? (i.e., grading to a 3.0 average)
    Anyway, just a thought. It seems simple enough to do, but I realize it could be a flawed idea.
    Cheers.
     
    BucketBoy, dar482, kemoarps and 2 others like this.
  2. LambicPentameter

    LambicPentameter Initiate (0) Aug 29, 2012 Nebraska

    I like this idea, so long as it included an user's average rDev, so that you could see how they are rating beers in general, as well as how they rate them with respect to how the community rates them.
     
  3. wordemupg

    wordemupg Grand Pooh-Bah (3,187) Feb 11, 2009 Canada (AB)
    Pooh-Bah Trader

    This did exist some time ago, I'm sure it could happen again.
     
    BB1313, Jugs_McGhee and BBThunderbolt like this.
  4. gcamparone

    gcamparone Pooh-Bah (2,131) Dec 6, 2011 Rhode Island
    Pooh-Bah Trader

    I like the thought but don't quite agree, it just doesn't seem like it would have much meaning. For example, someone who rates higher ranking beers lower than rAve could have the same average rating as someone who rates average/lower ranking beers higher than rAve
     
    Roguer and Jfriz25 like this.
  5. mudbug

    mudbug Pooh-Bah (1,762) Mar 27, 2009 Oregon
    Pooh-Bah

    Useless. It assumes all reviewers review for the same reasons. Many do not. I for one only rate beers I like and use the site as a database of my favorite beers. Other people only rate stuff they want to avoid. And some people rate every thing they taste even if it's a 2oz pour at a beer festival. Individual Stats are completely useless, in aggregate, that's another matter.
     
  6. Jugs_McGhee

    Jugs_McGhee Grand High Pooh-Bah (6,140) Aug 15, 2010 Texas
    Pooh-Bah Trader

    Loved this feature back when the site had it, and would love to see it again.
     
  7. BBThunderbolt

    BBThunderbolt Grand High Pooh-Bah (7,846) Sep 24, 2007 Kiribati
    Pooh-Bah Trader

    I'm hoping it comes back with the redesign. It's just a neat number to know. Kind of like how OBP and OPS are more useful stats, but every baseball player still knows their Batting Average. I think it's useful if you are looking at reviews and see that someone gives a beer a score with a high rDev, you could then look at that reviewers Average Score to see if they give, for example, every Imperial IPA 4+, while giving every Lager below 3.
     
  8. Gutes_Bier

    Gutes_Bier Maven (1,363) Jul 31, 2011 Germany

    Well, I mean it's not totally useless, right? :slight_smile: Generic Example (bear with me): If a person with 1,000 total reviews has an exact 3.0 Rating Average and (s)he has rated a beer I'm interested in as a 3.75, that tells me something doesn't it?

    The thought process stemmed from me reading posts where people think of a 3.0 as a "Meh" beer and a 4.0 as a "Good" beer. I think of a 3.0 as a "Good" beer and a 4.0 as "Very Good". Someone might see my 3.5 for Spaten Helles and think it is a bad score, but I might think it to be an above average Helles. One person's 3.5 may not be the same as another's.

    Not a perfect stat for sure, but I think it could be useful.
     
  9. Cvescalante

    Cvescalante Initiate (0) Dec 24, 2012 Texas

    The scores on my reviews show my opinions much more accurately than my hads. My scores are so all over the place that if anyone were to judge what I like based on them, it would be confusing, and it would be tough to accurately guess what beers I like over others.

    I'm all for stats though. If this were to happen, I'd probably get my shit together and review more because it already drives me crazy to see that I gave beer "a" a 4.25 and beer "b" a 4.0, yet I know that I'd rather have beer "b" any day of the week.
     
    BuckeyeSlim likes this.
  10. MacQ32

    MacQ32 Pooh-Bah (1,625) Mar 5, 2010 South Carolina
    Pooh-Bah

    I think a more accurate stat is how much your ratings deviate from the average score. I'd be look for something like rDev +3% meaning you review beers 3% higher (on average) than the aggregate average of each brew.
     
    Docrock, MEW, Gutes_Bier and 2 others like this.
  11. Ri0

    Ri0 Initiate (0) Jul 1, 2012 Wisconsin

    Interesting yes, meaningful no. Some beers I love compared to their scores; and this will be true for everyone.
    My top example is TG Dorothy. It is the best Lager I have ever tasted, but because it is a Lager it gets lower scores.

    That said, I guess it is really no different than the other scores on here, but another way to look at stats.
     
  12. TMoney2591

    TMoney2591 Grand High Pooh-Bah (6,139) Apr 21, 2009 Illinois
    Pooh-Bah

    As much as I like the average score stat in and of itself (no real reason), you should just look at the text of the reviews for the reviewer's feelings, rather than the number score. Trust me, it's much better information.
     
    russpowell, MEW, kemoarps and 2 others like this.
  13. jegross2

    jegross2 Initiate (0) Jan 3, 2010 Illinois

    This. Also like the idea, however. The number is a nice short hand in the aggregate though
     
  14. mudbug

    mudbug Pooh-Bah (1,762) Mar 27, 2009 Oregon
    Pooh-Bah

    Not in the least
     
  15. mudbug

    mudbug Pooh-Bah (1,762) Mar 27, 2009 Oregon
    Pooh-Bah

    Why is this useful? perhaps the just like IIpa's Does that make their opinion on IIPAS less useful? No.
     
  16. mudbug

    mudbug Pooh-Bah (1,762) Mar 27, 2009 Oregon
    Pooh-Bah

    Again, worthless without content. You assume the rDev is because they rate every beer they drink above average. This is simply not the case. Some People ( And I'll bet thats a huge majority) Do not bother to rate beers they don't like.
    Look, what I'm trying to get at here is that individual stats on rDev and overall score are meaningless without the context of WHY the person reviews in the first place. To imagine that you can wheedle out something useful by looking at a number WITHOUT READING THE REVIEW is lazy. Read the review, agree or not, pick reviewers that have somewhat the same tastes as you. Throw the Friggin numbers in the trash where they belong!
     
    TMoney2591 and BBThunderbolt like this.
  17. LeRose

    LeRose Grand Pooh-Bah (4,423) Nov 24, 2011 Massachusetts
    BA4LYFE Society Pooh-Bah Trader

    Somebody mentioned average rDev. The range on my revs is enormous, but I bet the average is pretty near zero. Not seeing too much utility with this one.
     
  18. Roguer

    Roguer Grand High Pooh-Bah (7,811) Mar 25, 2013 Connecticut
    Mod Team Society Pooh-Bah Trader

    I completely like it, along with an individual rDev average. That said, yes, you have to take into account that any individual may not be rating to a 3.0 standard, based on why they review (as GCamp and MudBug pointed out). I still don't mind it, because I'm not offended by numbers, and it gives me an insight into my own ratings (which I have by perusing them, but...well, it's easier).

    For example, I go and rate a beer a 4.39, and it has an rDev of +11.4%. Sure, I liked this beer better than others, but how did it compare to my overall ratings? If my overall individual average was 3.95, then yes, based on everything I rated, it's a beer that seems to stand up well to my individual tastes. (That might also be an indication that I either rate everything quite high, or I only review beers I like).

    So not totally useless, but not a statistic that speaks for itself. It requires some amount of context.
     
    Gutes_Bier likes this.
  19. opwog

    opwog Initiate (0) Jun 16, 2008 Minnesota

    The rDev average is far more important than what the person's average ratings are across the board. Some people have all the time in the world to rate every beer that they have, which is great, but not probably representative of the majority of people who have rated beers on here. Most people have a little time to contribute to reviewing or rating beers and then which beers warrant taking that time to each person depends a lot on their personality. Many people on sites like this consider themselves tastemakers, so when given limited time, they may only bother taking the time when they find something exceptional, so they would have exceptionally high over all averages. Then there are people who get more enjoyment out of bashing beers or feeling that they are saving the community by warning them of bad beers. So those people would have exceptionally low scores. Yet people who fall into both groups may be contributing very valid reviews, so what their over all averages are doesn't really mean anything, although it could be mistakenly read to imply something about the user. But the rDev speaks a lot ore to the trustworthiness of a users ratings.
     
  20. BBThunderbolt

    BBThunderbolt Grand High Pooh-Bah (7,846) Sep 24, 2007 Kiribati
    Pooh-Bah Trader

    Liking a particular style is fine. If one loves ImpIPA's, fine. But don't rag on a nice Kolsch just because it doesn't taste like Pliny. I believe there's value in knowing others bias's. You've seen the "Why are Lagers bland" type thread. If somebody loves Bbl aged stouts, or ImpIPAs, or Sours, isn't it useful to have a clue why they gave a Cask, English Mild a low score?
     
    2beerdogs likes this.
Thread Status:
Not open for further replies.