My attempts to come up with what this misogynistic creep would consider a "friendly superintelligence" keep resembling Elliot Rodger's pre-shooting manifesto.

I also noticed the ".eth" crypto name drop. :agony-4horsemen:

  • steve5487 [none/use name]
    ·
    2 年前

    it's worse than that it assumes that an all rational being once it exists would try and retroactively ensure it's existence which just isn't how linear time works and is unfathomably stupid

    • UmbraVivi [he/him, she/her]
      ·
      2 年前

      I had never heard of Roko's Basilisk before and yeah, upon looking it up it seems very, idk, out there? Like, way too sci-fi to be a serious "thought experiment".

      Also I don't really understand the "punishment" part can someone explain

      • NPa [he/him]
        ·
        2 年前

        Honestly it's just Pascal's Wager for tech bros, if there's a non-zero chance hell is real, you should repent. The punishment is being 'resurrected' as some form Boltzmann brain and then tortured for eternity. If that's the case, who cares about some copy of their mind-state being fed false sensory data at some point in the future?

        It presupposes quantum immortality, which is the idea that consciousness would be continuous if a perfect copy of your latest brain configuration is created, leaving no gap in-between Death and Resurrection, which is a long shot to put it mildly.

        • Judge_Juche [she/her]
          ·
          2 年前

          They later updated it to say that the AI creates a billion perfect copies of your conciousness, so it's impossible to know if you are the real version in the past or a copy in the future. It's then rational for all the copies and the real person to do what the AI wants because each one of them has a very good change of ending up in techbro-hell if they don't.

          I think a lot of people on LessWrong don't believe that conciousness will be continuous if someone just makes a perfect copy, even though its the supposed orthodoxy. So they made up this. How an AI could create a perfect copy of you is still just conveniently ignored.

        • UmbraVivi [he/him, she/her]
          ·
          2 年前

          Sounds like a creepypasta. There's so much stuff being assumed and speculated with no further explanation than "just imagine", I don't understand how anyone could take it seriously.

      • steve5487 [none/use name]
        ·
        2 年前

        It relies on you ignoring how linear time works the AI supposedly will want to retroactively ensure it's creation happens

    • Judge_Juche [she/her]
      ·
      2 年前

      Ya, like Rokos Basilisk is just a scary story the techbros tell each other in the present to try and get people working in AI. It really dosen't follow that once the AI is created it will fulfill its part of this story and waste a shitton of energy eternally torturing people. Like the all powerful future AI is not beholden to a fairy tale a bunch of dorks were telling each other, it would acutally be a very stupid AI if it did that.

      • steve5487 [none/use name]
        ·
        2 年前

        these aren't the techbros that know about AI either AI is actually quite boring and mainly involves computers doing statistics based on past results to generate predictions. These people learned about AI from star trek.

        It's the computer science equivalent of some guy talking about the dangers potentially posed by lightsabers