No More Auto-Retiring Beers

Discussion in 'BeerAdvocate Talk' started by Todd, May 27, 2022.

Thread Status:
Not open for further replies.
  1. Todd

    Todd Founder (13,172) Aug 23, 1996 California
    Staff Super Mod Pooh-Bah Society Trader

    We've been auto-retiring beers for many years, but at the end of last year we got a bit more aggressive to deal with the onslaught of one-off entries from mostly US breweries. While it definitely helped to clean up our beer and top rated lists, it was too clean and resulted in a ton of beers with no recent user activity (ratings) being tagged a retired despite they're still being in production. The impact was greatest with breweries outside of the US, but impacted the entire dataset and created confusion.

    So, we'll be doing the following going forward:
    • Auto-retiring beers has been disabled.
    • I'm currently in the process of reverting the auto-retirement (not tagging from user reports or mods) of beers since the last major update.
    • While I anticipate that our top rated lists will be impacted by this, beers still need to be rated within the last two years to be ranked/considered for top rated lists.
    • We'll be relying on the community to help us identify beers that need to be tagged as retired. See the "Update This Beer" link on any beer page.
    It's not a perfect solution, but gives us more control over the data.

    Please allow the system time to update related stats and lists.

    In the meantime, thanks to the mod team for letting me bounce ideas off of them, which led to this update, and thanks to everyone in advance for your support.
     
    REVZEB, Boone757, Domingo and 34 others like this.
  2. cjgiant

    cjgiant Grand High Pooh-Bah (6,248) Jul 13, 2013 District of Columbia
    Pooh-Bah Society

    I was actually a fan of auto-retiring, but then I came across a small local brewery that wasn't getting and probably wouldn't get the rating volume of other breweries. I had forgotten if a new rating would auto-unretire a beer (I don't think it does), but maybe it should (even if an occasional aged beer becomes "unretired" for a year).

    It's likely too much work and a guessing game as to an actual algorithm, but I wonder if a brewery's overall volume of beer ratings (across all beers) might weight the length of time before a beer is considered "retired."

    Anyhow, the just undone technique had its flaws, but I also think relying on the community is essentially doing away with retired beers. The last active data is nice to go one, and maybe that could be come more prominent and/or be adjusted/added to to include a brewery-specific version of "trending beers" filter/sort to help people find records for breweries with 100s of beers.

    Mainly just spitballing some thoughts trying (and likely failing) to be constructive without complaints. Thanks for continuing to try out things to improve the user experience here.
     
    Boone757, beergoot, Roguer and 8 others like this.
  3. Todd

    Todd Founder (13,172) Aug 23, 1996 California
    Staff Super Mod Pooh-Bah Society Trader

    Agreed. I think overtime we can do more with the `last active` field.
     
    beergoot, Roguer, SLeffler27 and 6 others like this.
  4. paulish

    paulish Pooh-Bah (2,878) Feb 2, 2014 New York
    Pooh-Bah Society Trader

    Thank you! Real good update.
    Will be great to add auto-retiring for beer with Zero Rating which was added two (for example) years ago.
     
    Todd likes this.
  5. muchloveforhops3

    muchloveforhops3 Grand Pooh-Bah (4,051) Apr 5, 2009 Montana
    Pooh-Bah Society

    Happy to be reading this- Thank you, @Todd!
     
  6. beer_beer

    beer_beer Pooh-Bah (1,915) Feb 13, 2018 Finland
    Pooh-Bah Society

    Nice update, now we are nearer the truth for at least the beers I'm drinking.
     
    beergoot, Todd and PapaGoose03 like this.
  7. zid

    zid Grand Pooh-Bah (3,036) Feb 15, 2010 New York
    Pooh-Bah Society Trader

    I can’t say I was a fan of the last shake ups with “inactive” and whatnot. I thought the auto moving of beers to “retired” would be confusing for the user interface. Why would someone look in the “retired” section for a beer that was in production? I’ve seen posts on BA that expressed this confusion.

    Active and retired are not opposites. Active refers to a beer’s status on BA, while retired should refer to a beer’s status with a brewer. In my opinion, the muddying of this is the issue.

    The BA database is at its best when consumers are entering in info directly from a brewer - name, style, ABV… and adding their opinion about a beer as a consumer (the review). It’s less effective when making presumptions about a beer.

    I felt like “retired” was always an issue. How do we know what’s retired? Beers leave a production schedule and then they come back. It feels like it’s frequently inaccurate. The auto-retiring created inaccuracies, but a manual retirement that relies on user/mod action would do the same.

    Why not just change the name of “retired” to “inactive” and increase the amount of time it takes for a beer to automatically become “inactive” - like 3 years? This way BA is using BA activity to make appropriate labels for beers rather than trying to imperfectly make claims about a beer’s status with a brewer without the appropriate info.

    @beer_beer ’s post above said something very telling: “now we are nearer the truth.” How about BA indicates BA’s truth rather than something only near a brewer’s truth?

    Frankly, I don’t even see a significant issue if you take this to it’s logical extreme and have “inactive” beers automatically become “active” with a review (as long as there isn’t a “retired” category). If someone is rating an out of production beer that’s been aged at least 3 years, is it a bad thing that the beer appears in the active list? The active list should reflect user activity. If that’s problematic, then make the automation only kick in when an inactive beer gets 2 ratings within a year (or something to that effect).

    In short - make a beer’s status reflect BA activity, have everything automated, and use terms that match this rather than ones that create a false impression.

    I understand why some really wouldn’t like this change, but it just seems like BA’s use of “retired” is forcing a square peg into a round hole. The relevance of the term fit an earlier era in beer and isn’t as applicable today. Sometimes the best solution is the most straightforward and clean one.
     
  8. Todd

    Todd Founder (13,172) Aug 23, 1996 California
    Staff Super Mod Pooh-Bah Society Trader

    Great feedback, @zid. Using last active in new ways is definitely the way to go.
    I agree, however, some beers are discounted, will never come back, and we need a way to tag them. We also get requests from brewers to retired beers. This is why the active/retired tag was created eons ago and most of the beers that have been tagged in the past are indeed no longer in production and haven't been for a very long time.

    Our trying to automate retirement was the issue.
     
    beergoot, zid, champ103 and 6 others like this.
  9. Todd

    Todd Founder (13,172) Aug 23, 1996 California
    Staff Super Mod Pooh-Bah Society Trader

    Update:
    • Last night I completed the process of reverting auto-retired beers since December 28, 2021, which is when the more aggressive criteria was put in place.
    • Beers rankings and brewery stats have been updated, which has resulted in more data being populated in lists across the site.
     
    beergoot, BigIronH, champ103 and 8 others like this.
  10. milkshakebeersucks

    milkshakebeersucks Pooh-Bah (1,736) Feb 10, 2020 Maryland
    Pooh-Bah Society Trader

    I like the term "Out of Production"; it covers lots of ground. As a specific example, look at a brewery like Spencer. Closed but still has 18 'active' beers on this site. And I know for a fact that there is still some of their beer in the distribution chains. So closed does not mean retired or inactive but it does mean they are not being produced.
     
    beergoot and ChicagoJ like this.
  11. Todd

    Todd Founder (13,172) Aug 23, 1996 California
    Staff Super Mod Pooh-Bah Society Trader

    I like "discontinued." It's shorter, a common term that means the same thing, and we can easily rename "retired." That said, many in the industry use the term "retired" too. So, we'd just be renaming something that means the same thing and has been widely used for decades.
     
  12. PapaGoose03

    PapaGoose03 Grand Pooh-Bah (5,159) May 30, 2005 Michigan
    Pooh-Bah Society

    I don't know how things work behind the scenes, so if I go thru the beer list of a local brewery and create a list of actual retired beers, is it necessary to update these beers one at a time on that beer's page, or can I update one beer but add the complete list in the dialog box for that first beer?
     
    beergoot and BigIronH like this.
  13. Todd

    Todd Founder (13,172) Aug 23, 1996 California
    Staff Super Mod Pooh-Bah Society Trader

    There's no bulk update option.
     
    beergoot, FBarber and PapaGoose03 like this.
  14. ATL6245

    ATL6245 Pooh-Bah (2,538) Aug 16, 2018 Georgia
    Pooh-Bah Society

    Personally, I think this is a good decision. There are several small breweries around me that just don't get the rating "foot traffic" on BA that they get on Untappd and their beers were retired even though they are regularly on tap or rotate seasonally.
     
    meanmutt, beergoot, lucius10 and 7 others like this.
  15. Reidrover

    Reidrover Grand Pooh-Bah (4,335) Jan 14, 2003 Oregon
    Pooh-Bah

    Thank you. I have reviewed quite a few up here in Oregon that were supposedly retired.
    We don't tend to review enough as a group.
     
    Rug, Todd and Harrison8 like this.
  16. Harrison8

    Harrison8 Grand Pooh-Bah (5,509) Dec 6, 2015 Missouri
    Pooh-Bah Trader

    This was my biggest gripe. My area doesn't experience a lot of BA traffic in general, with only the most popular breweries achieving a BA score on a handful of beers (after years of releases, mind you). The auto-retiring feature felt like a kick in the caboose without the local site traffic to keep the site accurate. Lots of false 'retired' beers. Happy to hear changes are being made as I think it'll help my area.
     
    meanmutt, beergoot, Rug and 4 others like this.
  17. ATL6245

    ATL6245 Pooh-Bah (2,538) Aug 16, 2018 Georgia
    Pooh-Bah Society

    I think it helps BA to have those listed too. I've noticed the majority of the time when I do google search on a beer name the BA reference comes up in the top 3 to 5. That's good exposure for BA.
     
  18. darktronica

    darktronica Grand Pooh-Bah (3,076) Aug 29, 2014 Indiana
    Pooh-Bah Trader

    Many of these types of issues are ultimately spawned in large part by having a small user base in many locales. Never thought I'd say this, but this could be a use case where it's worth a "soft," behind-the-scenes, and one-way integration of the BA and Untappd databases. It doesn't have to be perfect, and it doesn't have to impact beer listings or scores, but BA could query the last Untappd check-in for a beer of the same name from the same brewery before classifying it as active or inactive. I'd go with a fuzzy scheme where every word in the BA beer name has to be in the Untappd name, and some words can be substitutes (e.g., "BA" and "barrel-aged" and "barrel aged" are equivalent), to deal with non-standardization in how names get formatted, but that would likely be a major improvement that remains scalable without relying on user input.
     
  19. zid

    zid Grand Pooh-Bah (3,036) Feb 15, 2010 New York
    Pooh-Bah Society Trader

    Thanks. I figured that. A brewer's request to specifically "retire" a beer would make sense if BA didn't make any distinctions or if BA had a "retired" distinction. If retired was replaced with "inactive," then brewers can request that a beer be moved to "inactive." It serves a similar purpose but uses a different label. I can't imagine brewers being too miffed if such beers were called "inactive."

    With a non-automated "retired" system, if Sierra Nevada decides to bring back regular Otra Vez as a temporary taproom draught, or as one of their very small can runs, or as a beer in a mixed pack - either BA site users will have to live with the beer being identified as "retired" when it isn't (and if that doesn't matter, then I'm not sure how much any of this matters)... or BA mods will have to switch it to active (perhaps after a user report) and then remember to switch it back to retired at some point (I assume).

    Given the high volume and degree of fluidity with beer releases today... it seems to me that having a manually regulated beer retirement system is not as critical or relevant as simply having a beer listed and represented in the database. Those are obviously not mutually exclusive, but with a finite amount of time that one can spend keeping the database up-to-date, it might be better to use that bandwidth to work on the addition of beers rather than the maintenance of what's already here.

    None of this is meant as a criticism... it's just food for thought in case an additional perspective helps. I clearly value your site. I suspect users would be annoyed if the site took on the approach in my posts.
     
  20. Chuckdiesel24

    Chuckdiesel24 Pooh-Bah (2,862) Jul 6, 2016 Illinois
    Pooh-Bah Trader

    I don’t agree with this. In the otra vez example, which is a really good example, hopefully it gets flagged as not retired (I acknowledge the possibility it might not, but it’s more likely than some other breweries), then it would be shown on the regular list until it gets specifically marked as retired. I don’t think it should be retired when the draft kicks at SN; they’ve shown that they will occasionally produce the beer at that point. And the current system will work that way.

    Doing it the way you suggested - via automation - if someone checks in a Don quijote tomorrow - now it will be listed as active on the BA250 for 2 years.

    That particular beer may be an extreme example, but there are more beers that would fall into that grouping than you’d think. Take BCS proprietors - around with a different flavored vintage since 2013 - I just checked and the only one that wouldn’t be active if you went by checkin recency is Prop 2015, which is the infected year (and still almost makes the cut). A bunch of those beers would make the BA 250, and practically all would make the Illinois 100. In my opinion, that would render those lists meaningless.
     
  21. defunksta

    defunksta Pooh-Bah (2,428) Jan 18, 2019 North Dakota
    Pooh-Bah Trader

    I like the automation aspect, because I see so many beers on here that I find fresh incorrectly listed as "retired". But also see @Chuckdiesel24 point. What if you kept the automation to unretire beers, but increased the requirement for beers to make the leaderboard with a cutoff, say 5 or 10 or some number of reviews within the past n number of years? Or maybe if the beer hits that threshold of recent reviews, it trigger a BA moderator to review the beer as active? Again, just ideas here.
     
    beergoot likes this.
Thread Status:
Not open for further replies.