• @[email protected]
    link
    fedilink
    English
    27 months ago

    Are you using a self hosted open source system, or a saas subscription? I’m genuinely interested.

    • @[email protected]
      link
      fedilink
      English
      27 months ago

      We use a home grown classification model for our customer facing stuff. There are some applications of LLMs we are using a SaaS for as it’s quick to get going but we are also working on fine tuning an open source model as well so we’ll see what ends up working better in terms of cost vs performance. That’s not going to be customer facing though, we don’t serve any generated text to customers.