• Abracadaniel [he/him]
    hexagon
    ·
    3 months ago

    It's interesting how words with similar semantic content are close together in the abstract vector space. Those groupings seem like they could reveal the idological content of the training data.

    • Prometheus [they/them, undecided]
      ·
      3 months ago

      Lol I don't have it on hand, but someone did a centroid analysis of another smaller but open GPT model, and found the "word" at the "center" of the model space was "a man's penis"