Frankly, not sure where to begin with this one. Some here have already pointed out how it can easily be trained to produce racist/biased data which is a big red flag to begin with. But am I the only one thinking about how this deep-learning, AI algorithm is going to render millions obsolete at the behest of capital? As has been the case with almost everything developed under capitalism , what a marvelous discovery that will in all likelihood be used for nothing but exploitation. And do I even have to mention how our leaders are geriatric and couldn’t regulate this shit to save their lives?

Unless this is somehow made open-source (and soon), we’re fucked.

  • culpritus [any]
    ·
    2 years ago

    Has anyone asked it for the source code yet?

    • space_comrade [he/him]
      ·
      edit-2
      2 years ago

      Its "source code" is mostly billions of weights which are usually floating point numbers from -1 to 1. Nobody really knows how exactly it works, it's mostly a black box.

      Also it's impossible for it to be able to output it's own weights since its own weights would have to be in its training set which of course can't happen since you only get the weights after the training is completed.

      • culpritus [any]
        ·
        2 years ago

        huh, sounds like machine learning is just an automated form of ideology - very cool

        :AI-cool:

    • drhead [he/him]
      ·
      2 years ago

      OpenAI doesn't release their models. GPT-3 also requires about 350GB of VRAM -- in order to actually run it, you would need about 5 A100 80GB workstation cards which will run you about $15k each. Good fucking luck with that lmao.

      • culpritus [any]
        ·
        2 years ago

        That actually sounds cheap from a bean counter perspective. Under $100K for AI copy writer that never sleeps or needs insurance. Now I'm gonna have nightmares about this being used by law firms in :countdown:

        • drhead [he/him]
          ·
          2 years ago

          Yeah, but it's going to usually be cheaper for people to rent the service, since OpenAI can have their TPUs running close to full time instead of as-needed. If OpenAI isn't successful in making a marketable product that isn't just a toy then text generation models will be pretty much dead for anything but private tinkering since the smaller models suck ass by comparison.