• Aria@lemmygrad.ml
    ·
    4 months ago

    So what exactly is this? Open-source ChatGPT-alternatives have existed before and alongside ChatGPT the entire time, in the form of downloading oogabooga or a different interface and downloading an open source model from Huggingface. They aren't competitive because users don't have terabytes of VRAM or AI accelerators.

    • Schlemmy@lemmy.ml
      ·
      edit-2
      3 months ago

      Edit: spelling. The Facebook LLM is pretty decent and has a huge amount of tokens. You can install it locally and feed your own data into the model so it will become tailor made.

    • ☆ Yσɠƚԋσʂ ☆@lemmy.ml
      hexagon
      ·
      4 months ago

      It's basically a UI for downloading and running models. You don't need terabytes of VRAM to run most models though. A decent GPU and 16 gigs of RAM or so works fine.