Update on importing RateBeer data

Blog Discussion in 'BeerAdvocate Talk' started by Todd, Jan 9, 2025.

Tags:
Thread Status:
Not open for further replies.
  1. Todd

    Todd Founder (13,518) Aug 23, 1996 Finland
    STAFF Mod Team Society Pooh-Bah

    Just wanted to drop a quick update on importing data from RateBeer...
    • Looks like I have everything I need to explore working with the data/samples of exported user ratings that to some crossover users.
    • At first glance, this could significantly increase the size of our beer database (especially from breweries outside of the United States).
    • Next steps: is to write some scripts to play around with matching and inserting missing data, and double check to see if there's anything else I need before it's too late.
    More to follow...

    In the meantime, feel free to spread the word to those who might be interested.

    Kipps! :beers::heavymetal:

    Related:
     
    TrojanRB, LXIXME, UncleJimbo and 53 others like this.
  2. PapaGoose03

    PapaGoose03 Grand High Pooh-Bah (6,057) May 30, 2005 Michigan
    BA4LYFE Society Pooh-Bah

    Very nice! :clap:

    If you need warm bodies to help with testing I'm certain that you have many members who have time to volunteer, including me.
     
    Arbitrage411, Shanex, LXIXME and 11 others like this.
  3. chrisjws

    chrisjws Grand Pooh-Bah (3,302) Dec 3, 2014 California
    Pooh-Bah Trader

    At this scale it may not work, but I have used GenAI in scripts before for fuzzy matching.
     
  4. 2beerdogs

    2beerdogs Grand Pooh-Bah (5,682) Jan 31, 2005 California
    BA4LYFE Society Pooh-Bah Trader

    Sounds daunting. Much appreciation, Todd.
     
  5. Todd

    Todd Founder (13,518) Aug 23, 1996 Finland
    STAFF Mod Team Society Pooh-Bah

    Yeah, it's a lot of data to sort through.
     
  6. Whyteboar

    Whyteboar Grand Pooh-Bah (4,286) Jun 7, 2008 Michigan
    BA4LYFE Society Pooh-Bah Trader

    I’m a data geek from way back, all kinds of data matching techniques. I too would be happy to help, just say the word.
     
  7. LXIXME

    LXIXME Grand Pooh-Bah (4,966) Oct 3, 2007 New Mexico
    Pooh-Bah Trader

    Best of luck, I really hope this works out. Would really love to see how it shakes things up on here.
     
  8. Arbitrage411

    Arbitrage411 Devotee (357) Dec 26, 2024 Pennsylvania
    Society

    Terrific. Was hoping to get news like this. Keep up the good work.
     
  9. tnkw01

    tnkw01 Crusader (469) Feb 24, 2008 Tennessee
    BA4LYFE Society

    This wonderful news!! I pray is works out. Cheers!
     
  10. Arbitrage411

    Arbitrage411 Devotee (357) Dec 26, 2024 Pennsylvania
    Society

    Would like to upload these 408 beer reviews from RateBeer. There must beer 100’s of thousands from other reviewers that could, if dovetailed with BA, form quite the Critical Mass of a beer reviewing Gold Standard.
     
    TrojanRB, Bitterbill, LXIXME and 3 others like this.
  11. Cydrman

    Cydrman Initiate (170) Feb 14, 2015 England
    Trader

    Hi, I'm just wondering if there's been any update to this.
    Is it going to be feasible to uploads rates from RB downloads?
    Thanks
     
    Arbitrage411 and ChicagoJ like this.
  12. TheEpeeist

    TheEpeeist Maven (1,434) Nov 5, 2008 Virginia
    Trader

    any thoughts as to how you would convert the ratings?
     
    ChicagoJ likes this.
  13. Todd

    Todd Founder (13,518) Aug 23, 1996 Finland
    STAFF Mod Team Society Pooh-Bah

    No updates at this time other than: the scale of the project is massive, I'm one person, and I have higher priority projects that demand my attention.
     
    ChicagoJ and John_M like this.
  14. Todd

    Todd Founder (13,518) Aug 23, 1996 Finland
    STAFF Mod Team Society Pooh-Bah

    If you mean converting to our five attributes (look, smell, taste, feel, and overall), it should be a relatively easy conversion, but the way RateBeer weighted attributes wasn't what I'd call standard for the industry. Anyway, I haven't mapped this out yet, but here's the info you'd need to make it happen.

    Points that RateBeer allocated for each attribute:

    Look (Appearance): 5
    Smell (Aroma): 10
    Taste (Flavor): 10
    Feel (Palate): 5
    Overall: 20

    Here at BeerAdvocate we use a 1-5 point scale for each, but then apply weights to each attribute before calculating the final rating for flexibility and ease of use.

    From: How to Review a Beer

    Look: 6% (3)
    Smell: 24% (12)
    Taste: 40% (20)
    Feel: 10% (5)
    Overall: 20% (10)

    Ours works out to be basically what the Beer Judge Certification Program (BJCP) and American Hombrewers Association (AHA) use on their beer score sheets (points noted above within the parentheses) for competitions.
     
Thread Status:
Not open for further replies.