https://towardsdatascience.com/how-this-a-i-became-a-communist-ddf9146bc147

  • syzygy [none/use name]
    ·
    4 years ago

    Nevertheless, the results are promising, GPT-2 was able to understand the underlying philosophy, the different relations that exist within those revolutionary theories and the different actors.

    For the love of everything: this is not what GPT-2 (or GPT-3 which is the new hype) is doing. There is no understanding taking place and the better way to explain GPT to laypeople is that it's like a text-completion engine on steroids.

    Still cool though. Let us free ourselves from the labor of posting!

    • TemporalMembrane [she/her]
      ·
      4 years ago

      The cool thing about GPT-2 and GPT-3 is that there is apparently no upper limit on how good they are at writing text. You just give em more and more neurons or whatever and they keep improving without plateauing.