Rating Places - How do you do it?

Talk Discussion in 'BeerAdvocate Talk' started by Harrison8, Jan 27, 2017.

Thread Status:
Not open for further replies.
  1. Harrison8

    Harrison8 Grand High Pooh-Bah (6,285) Dec 6, 2015 Missouri
    Pooh-Bah Trader

    Did anyone else get an email from Beer Advocate asking them to add beer-centric places?

    I found it inviting that BA wants to improve it's place ratings and reviews on top of it's beer, but before reviewing more places, I would like some clarification on a few items. I'd love to hear how various Beer Advocate members and owners answer these.

    How often do you review a place?

    How often do you check reviews of a place on BA? Is it for a trip? Or just seeking a new bar in town?

    Per the rating system for places, "Quality" is one of the 5 areas. How does "Quality" play into the rating system? Quality of beers? Quality of service? Quality of the wood working done to make the bar? Quality of the pours or in their selection of glassware?

    Is there a standardized form, or FAQ on place reviews and ratings like there is for beer? I found this page, but it doesn't offer any explanation on any of the five rating categories.

    Personally, I would review more local places, but I'm always left questioning how to interpret the quality rating. I also find vibe hard to rate, just because it can vary so widely between people or how I'm feeling that day. Do I want to be in a quiet place? Or play video games and drink BCBS? Both of those bars are equally great, but both have a completely different vibe. That's one of the reasons I always review just to make sure there is a justification in my rating for vibe. Anyway, I'm curious what other BA members and folks think about the places section.

    Cheers.
     
    cjgiant, AZBeerDude72 and LeRose like this.
  2. Immortale25

    Immortale25 Grand Pooh-Bah (3,775) May 13, 2011 North Carolina
    Pooh-Bah Trader

    After sporadically reviewing a measly 5 places within the first couple years I was on this site, I simply gave up because of a lot of the reasons you mention
    I do check reviews of places on BA whenever I'm making a trip out of town, but not really at any other time
    I think this is another reason why I find it difficult to write place reviews. In order to properly write up an establishment, you have to be as detailed as possible with this area as well as with the other 4. I've gotten to where I can write a beer review in as little as 5 minutes and have done it justice. Sitting down to write a place review would take me at least 15 minutes before I felt like I had covered all the key points.
    And another reason I felt like the writing of place reviews was a futile effort (for me). In a year or two, there's a good chance that the douchey bartender who made my experience unpleasant would not be working there any more. On the other hand, if the beer was great and I gave a good review, what if the brewmaster quit and the beer started sucking? My review would pretty much become useless. I know you can argue that when you review a beer, it might change later on for a number of factors (brewery scaled up or also got a new brewmaster who couldn't duplicate the recipe) but with that, it's just a beer, not an entire company.

    The final and most important reason I quit place reviews is the same reason I quit Yelp! I found myself only being inspired to write reviews for extremely positive or extremely negative experiences, and of course mostly the latter. That's why I dislike all those kinds of sites: People are more likely to remember and be vocal about their bad experiences, not their good ones. And I'm guilty of it too.

    Also, plain and simple, I already make it a point to give a full review of every new beer I try. If I gave a full review for every new place I visited, I'd never be off my phone and computer. That being said, I really should at least give a rating to every new place I visit now that the simple 1-5 rating system has been implemented for it (has been for a while now, I know).
     
    cjgiant, LeRose and Harrison8 like this.
  3. Squire

    Squire Grand Pooh-Bah (4,385) Jul 16, 2015 Mississippi
    BA4LYFE Society Pooh-Bah Trader

    I like the places section. If I'm traveling to another part of the Country I appreciate the opinions of BA members on places or stores I might want to visit.

    All I ask is a fair description, which is what I try to do. No demerits if a place isn't quite my style, rather I should rank it according to how well they carry off their own theme.

    I don't think one has to be a restaurant critic to make a quality assessment. I believe most of us can recognize whether the food is tasty and well prepared, and whether the beer is average, good or exceptional.
     
    VAcrossr, shadyside, Jaycase and 6 others like this.
  4. Harrison8

    Harrison8 Grand High Pooh-Bah (6,285) Dec 6, 2015 Missouri
    Pooh-Bah Trader

    Great break down. Thank you! I added a few places and eagerly reviewed a few when I first joined, but have found it to be much more tedious then providing a beer review. After all, there isn't a standard set of descriptors for each category. Plus, there is no standard interpretation of any of the categories unlike beer, so every place I review every couple of months, I have to re-interpret what each category means and how to rate within it. I also do find myself slipping into more response biases when I'm reviewing places. Particularly when I get bad service. It's tough when you get one snapshot of a place that you visited on a vacation or trip.

    Props on the beer reviewing as well! That's my current goal. If I'm drinking a new beer, provide a review, not just a rating!

    I agree, it doesn't take a trained critic to rate and review places, but if everyone has a different interpretation of what "quality" means on BA, how do we trust the ratings and reviews?
     
    LeRose likes this.
  5. drtth

    drtth Initiate (0) Nov 25, 2007 Pennsylvania
    In Memoriam

    @THSdrummer

    What Squire said.

    I also try to avoid rating without reviewing since I think those looking for something need a context for what the numbers might mean.
     
    cjgiant, Harrison8 and Squire like this.
  6. LeRose

    LeRose Grand Pooh-Bah (4,423) Nov 24, 2011 Massachusetts
    BA4LYFE Society Pooh-Bah Trader

    I think rating places might be more difficult than rating beers. It believe it to be even more subjective because it is so dependent on other factors. I don't do the bar scene, but we do eat out a lot and Lord knows I go to plenty of package stores.

    One difficulty is variability - chefs, bartenders, wait staff, bottle shop staff, hell even owners - they all come and go and can have a significant impact on the overall experience. And I think you have to differentiate the two. One of my favorite bottle shops you never know what you are gonna get from the owner - can be a real Jekyll and Hyde thing, but the cleanliness and beer selection means I will put up with a little Hyde. I wouldn't in a restaurant.

    I would add a question too - what defines "beer-centric". I added a little vegetarian joint a couple years ago. Is it a place to go to sit and drink? No - of course not. That said, they have a small but always outstanding tap list, the food is great (even for a dyed-in-the-wool carnivore like me), and the "vibe" is, well, interesting with all sorts of people. Is it for every BA? Of course not. But for somebody looking for a change of pace it would fit the bill and while it is not the typical thing, my thought was it is owed to the community to include different choices.

    I do use the place reviews when I travel, especially if it is a work trip. While I can ask the local people, it is nice to visit the hive mind here where we already share a common interest. And, very frankly and not intended to sound snotty, in some of the places I go when you ask about beer it's "yeah...we got both kinds...Bud and Bud Lite". I find place reviews especially useful for work trips where I may be going somewhere remote and have limited time. I can try to find a retail outlet to stock up some hotel beers. Just did that on my recent trip to WI, and the Madison HyVee worked out great - all I found in the local shop where I was working was old inventory for singles/mix six. Yet that shop was rated highly...hmmm...

    For me, quality is a combination of all those things you mentioned, and I think "vibe" plays a part when it comes to "quality" of experience. A small (but well-selected) beer list doesn't bother me - if I am going to eat, I'm not gonna sit there for hours drinking beers. One good choice is all I really need. But is the place clean - if they can't bother to keep the place clean, how do I know the tap lines are clean or that bottles/cans have been cared for, or my food is made in a sanitary kitchen? Cleanliness is a huge factor with me in terms of overall quality (stores and elsewhere).

    If everything else is right and the service is unsatisfactory, then that is a turn off, but it depends. Service - unless it's bad right from the get-go, you are pretty much already committed. A store you can walk out, of course, but if you are seated graciously by the host/ess in a restaurant and then find out your waiter/waitress is an asshat? My bipolar store owner I mentioned - I will let that ride because I don't really need to interact with him and I've learned not to on the down cycles. In a restaurant, you can get stuck with it at least for one time.

    Agree that vibe can be highly variable. I try to make myself neutral. For instance, I might go to Jack's Abby just because I want to go there, have some wings, pizza, and fresh beer. It's a place that always has a kind of a high energy feel to it although it usually isn't overly raucous - sometimes I dig that and sometimes I don't. But I feel that I can "participate" as much or as little as I want. As long as I don't feel like I don't belong - "you ain't from around here" - I'm pretty much OK with trying to understand the vibe for what it is or could be. When I went to Oxbow in Portland, I really liked the semi-industrial "vibe" of the place even though there was almost nobody there. I can see how the joint could be really jumpin' when filled. When I went to a particular local brewery, the neighborhood bar flies and the servers made it uncomfortable, like we were upsetting the natural flow of the universe. For me, vibe is about how do I "feel" when I go there regardless. If I were to go to a sports bar expecting to sit and have a quiet conversation, bad on me. The "personal" vibe was wrong for my expectation, but it's great for a sports bar, so I would still rate the vibe accordingly. It's not the place's fault that expectation and reality were misaligned.

    How do you rate vibe at a place like Proclamation here in RI - until they move they have a tiny tasting room, it's been pretty well jammed, it's loud, it's inefficient so service suffers a little, yet you feel comfortable there and the staff treats you well. So it's crowded, but it certainly doesn't have the negative flow going on. You go to Trillium and just feel like you are standing in line - or at least it did on my last visit - and it sorta just feels like a store. It's neither bad nor good on it's own merit. Refer to: "things change" because they are making efforts to create a more enjoyable customer experience.

    Like I do with beers, I do the best I can, but I might be a bit more harsh. With a beer review, it is just the beer. I picked it, took it home (usually) and drank it and it's all on me. With a place, there is an experience involved and the expectation is different whether that is a store, tasting room, restaurant, etc. The expectation is higher because interaction, to whatever extent, is implied and has a significant bearing on the experience.
     
    Harrison8 likes this.
  7. StoutElk_92

    StoutElk_92 Grand Pooh-Bah (4,045) Oct 30, 2015 Massachusetts
    Pooh-Bah

    I think you might be thinking too hard about it. Just rate things as accurate as you possibly can. All ratings and sometimes reviews are subjective, and not everybody rates things the same way. When I think of quality in a place I think of things like how clean or dirty it is, how nice it is overall, if things are neat or messy, the quality of the products, etc. If I go into a beer shop that looks like a sloppy convenient store that has products all over the place, hard to get, no prices, dusty bottles, I will rate the quality lower than a shop that is all neat and tidy with easy to find high quality products that have prices, etc.
     
    Todd and Harrison8 like this.
  8. Todd

    Todd Founder (13,518) Aug 23, 1996 Finland
    STAFF Mod Team Society Pooh-Bah

    Yep. It's really not that complicated, and it doesn't take an in-depth report to get your overall impression of a place (or beer) across to others.
     
    Jaycase, StoutElk_92 and Harrison8 like this.
  9. Harrison8

    Harrison8 Grand High Pooh-Bah (6,285) Dec 6, 2015 Missouri
    Pooh-Bah Trader

    I'll think a little less about it then. Can you all put up a place review guideline like you have for the beer? I do think it would help standardize things a little bit. Clearly folks are getting it who have responded, but we have had limited responses so far.

    And for clarification, I mostly just find the "quality" rating to be the questionable part. I could review places based on selection, service, and vibe all day long.
     
  10. Todd

    Todd Founder (13,518) Aug 23, 1996 Finland
    STAFF Mod Team Society Pooh-Bah

    Yes. It's something we've had on our to-do list for quite some time now, but I'll see what I can do about writing something up and clarifying a few things to make approaching place reviews easy.
     
    Wasatch and Harrison8 like this.
  11. Harrison8

    Harrison8 Grand High Pooh-Bah (6,285) Dec 6, 2015 Missouri
    Pooh-Bah Trader

    Awesome. I do think that'll help at least a little. Thanks for listening to our feedback and answering questions.

    Cheers.
     
  12. cryptichead

    cryptichead Grand Pooh-Bah (4,857) Jul 3, 2014 Illinois
    Mod Team Society Pooh-Bah Trader

    I agree that the "Quality" parameter has been confusing. I tend to default to the average quality rating of the beer, since food, service, and vibe already have their own categories.
     
    cjgiant and Harrison8 like this.
  13. gatornation

    gatornation Grand High Pooh-Bah (10,388) Apr 18, 2007 Arizona
    Pooh-Bah Trader

    I really enjoy written reviews by BA members in the directory/places. I try to add/review as many as i can. When i go to a new city i like to read what places to go to for stores,brewpubs,restaurants in this city and i find it very valuable. Vibe & quality are subjective to the reviewer, we all look for different markers ie(kid friendly,#of taps,outside seating,food trucks,mix sixer selection,growler fills,... on &on) when reviews are written we as members can make a decision based on other BA reviews what's best for us and family when visiting other parts of the country. Written reviews of all venue's help to make a decision on this IMO.
     
    Harrison8 likes this.
  14. eppCOS

    eppCOS Grand Pooh-Bah (4,570) Jun 27, 2015 Colorado
    BA4LYFE Society Pooh-Bah

    Criteria for reading, interpreting, and yes.... writing place reviews (for me):
    1. The beer, their own, or taplist, has to be great-very good.
    2. The service has to be friendly.
    3. The space, as a third factor, is kind of a big deal - that includes design, light, where they put customers vs the beer itself, etc.
    4. Ambiance - if it's filled with drunks, or too loud, or overrun with dogs. It's out. Only exceptional beer, across the board, might trump #4 for me.
    5. Paying attention to what people are drinking here on BA, what their tastes are like, is key to interpreting what places are great (or might be, to my taste) so that a frequent WBAYDN poster who prefers maltier stouts, or saisons will give better pointers on places that produce those styles. Or (for my taste) I pay attention to the people I know are hop-heads and they highly recommend a place....then they have my attention. To each their own...
    Cheers all.
     
    Harrison8 likes this.
  15. WesMantooth

    WesMantooth Grand Pooh-Bah (4,844) Jan 8, 2014 Ohio
    Pooh-Bah Trader

    I try to review every place I visit because to me, that is one of the most valuable resources. When I am out of town looking for a good bottle shop, or trying to decide between breweries I lean heavy on other people's opinions.

    I do think that the "quality" section is a little vague, but I approach it the same way I do the "overall" score for beer. I try to take the whole picture into consideration. So yes, woodworking, and glassware come into play for me. Along with parking, restrooms, decor, use/layout of space... You can usually tell the ones that have really made a commitment to investing in the big picture.

    Personally, I am not a fan of the "vibe" score. While it is important, it can mean so many different things to people. Just look at the thread about Tap Room Turn-offs. A lot of people don't care much for live music. I love it (not at a front row Ted Nugent concert decible level of course, so I get the not being able to talk yo each other thing). Some people think TVs kill the vibe of a place. Also, more often than not, it doesn't really apply to a carry out location. I would just as soon address these type of things in the comment section.
     
    cjgiant and Harrison8 like this.
  16. PapaGoose03

    PapaGoose03 Grand High Pooh-Bah (6,057) May 30, 2005 Michigan
    BA4LYFE Society Pooh-Bah

    I'm retired and travel a lot since I now have the time. Even before I retired, travel was a part of my job, and I used the Places feature to scout out breweries to visit for dinner when I stayed overnight somewhere. I've visited over 400 breweries, and have reviewed 294 of them, except 6-8 that were rating-only because they are highly popular places with many reviews already. (The other 100 or so that aren't reviewed were brewery visits prior to my joining BA.)

    The Quality factor in a rating or review has been mentioned a number of time above as having uncertainity about what it means. To me, because the Vibe, Service and Food have their own rating categories (which are subjective opinions), that leaves beer quality to insert under this Quality category. I try to be objective in my rating of this category by assigning a number from 1-5 just like a beer rating here on BA (although I don't use the same 5 BA criteria). I then average my individual ratings for an overall score of the 4-8 sampler glasses that I drank, and that score ends up being my Quality score. (If you read any of my reviews, that score pertains only to my rating of the brewery's beers.) So my subjective tasting skills become as objective as I can make them.

    I also am objective in the Selection category by again using a scale of 1-5 and assigning in quarter-point increments in a chart that I created yhat gives a 1.0 score for 1-2 beers on tap, then 3-4 beers geting a 2.0 score, etc. on up to 20+ beers getting a 5.0 score. I'll adjust a quarter point or so downward if the tap list is unbalanced and has too many IPAs, for example, but this is rare.

    A mention should also be made for the Karma value involved here for the Reviews (whatever that secret scoring mechanism might be), and that value requires a certain number of characters in your review text to earn a Review classification instead of being considered only as a Rating. (Assuming there is a Karma point difference between a Rating and a Review.) I think the threshold is 150 characters to be a Review, and I think that includes the spaces, so only like 3-4 sentences can get you credit for a full Review.

    I use your reviews a lot, and I hope you rely upon mine.
     
    Harrison8 likes this.
  17. Harrison8

    Harrison8 Grand High Pooh-Bah (6,285) Dec 6, 2015 Missouri
    Pooh-Bah Trader


    Wow. I really appreciate you responding. I really enjoy your level of objectiveness in your reviews and ratings. Bias has a habit of slipping into most any review or rating system, especially when some beers, styles, and places provide such a euphoric experience, and others just seem.. dull and lacking.

    I do like your use of quality. I think it's a fantastic example of rating within that category for breweries. Your hard-set numbers for selection are also great. Very thorough. If I could sum up education school, it's always create a rubric for any projects or assignments that feature a creative answer (i.e. not a multiple-choice math test). Having hard set numbers for good selection vs. not fits very much in line with creating a rubric, so I like that. Having percentiles for even style distribution is also nice and well through out. Not suggesting BA should provide a rubric for rating places, but I do like how thorough and consistently that rates a place.

    There was talk about reviews being given more weight in beer karma calculations then ratings. Whether or not that is the case cannot be answered. Personally, I do find reviews crucial for the community. Ratings are great for quick glances when in a bottle shop, or when in the passenger seat (not driving!) and looking for a bar to visit. Reviews really provide the juice of the details. If a beers or place gets hyped up, ratings may be inflated, whereas providing reviews lets the potential customer know if it's even worth visiting, or if individuals can justify giving a beer or place a 5 out of 5 or just as important, a 1 out of 1. Is it really that bad? Or did you just get a crum-bum bartender? Justify it. That's why I review every beer I have instead of popping up a rating. It also helps me so I can come back and see why I enjoyed the look or feel or flavor of a beer so much, or why the vibe or selection was so great.
     
    PapaGoose03 likes this.
  18. donspublic

    donspublic Grand Pooh-Bah (3,552) Aug 4, 2014 Texas
    BA4LYFE Society Pooh-Bah Trader

    I try to review most places I go to. I just got back from India and added some very obscure things, 1) a market/grocery store that sold beer 2) a brewpub that just started out. I tried to review every beer I had when I was over there, mainly because that place is a pain in the ass to get around, and if you have something close by, then that makes it nice. I don't really get caught up in how to review something. I think you need to look at the review from the prospect of notes for you if you go back. As I get older, I tend to forget experiences I have had at certain places, so these review help me remember the time that I had when I was there. I hope that it also helps others decide if something is worth their time.
     
    Harrison8 likes this.
  19. BBThunderbolt

    BBThunderbolt Grand High Pooh-Bah (7,846) Sep 24, 2007 Kiribati
    Pooh-Bah Trader

    Well, I take into consideration what the place seems to be trying for. Are they trying to be a quiet little spot, but one table is being loud and raucous? Then I won't hold that against the place. But, if they're trying to be a quiet place, and they have concrete floors, hard square walls with nothing to absorb sound, and high energy staff, then yeah, that would affect how I rated it. Instead of "Vibe" (a term I personally despise), consider using the word "comfort" in your mind. Do you feel comfortable there, for what they're trying to do? By all accounts I've heard and read, I would likely hate Three Floyds tap room under any conditions: loud music in a genre I hate, brusque, even rude, staff, crowded. If I were ever to go there, I doubt a good review would come from it, because they're trying for a comfort that's not mine. It's clearly something they, and a lot of people, do like, so it works for them.
     
    Harrison8 likes this.
  20. Harrison8

    Harrison8 Grand High Pooh-Bah (6,285) Dec 6, 2015 Missouri
    Pooh-Bah Trader

    Lots of good responses. Thanks all for sharing. I do tend to think a bit hard about this, but as a volunteer teacher and coach I try and find the best way to assess all students the same way for a particular assignment. It may not be ideal for individual students, but at least they're aware of what they'll be assessed on for that assignment. Hence my struggle with reviewing places. We've got several different responses for how folks rate "Vibe" and "Quality". Not to say that'll ever be standardized. There are folks who review a beer based on what the label claims, those who review a beer based on what style it's based in, and then others who simply review a beer as a beer. Perhaps there isn't a way to formulate place reviews, especially with brew pubs, breweries, restaurants with a big tap list, and bars all sharing the same umbrella. I just find it beneficial to hear and consider how others arrive at their place ratings so I can objectively review places. I hope folks lurking or considering reviewing more places have found this helpful as well.

    Cheers.
     
    StoutElk_92 likes this.
Thread Status:
Not open for further replies.