My attempts to come up with what this misogynistic creep would consider a "friendly superintelligence" keep resembling Elliot Rodger's pre-shooting manifesto.

I also noticed the ".eth" crypto name drop. :agony-4horsemen:

  • UmbraVivi [he/him, she/her]
    ·
    2 years ago

    I had never heard of Roko's Basilisk before and yeah, upon looking it up it seems very, idk, out there? Like, way too sci-fi to be a serious "thought experiment".

    Also I don't really understand the "punishment" part can someone explain

    • NPa [he/him]
      ·
      2 years ago

      Honestly it's just Pascal's Wager for tech bros, if there's a non-zero chance hell is real, you should repent. The punishment is being 'resurrected' as some form Boltzmann brain and then tortured for eternity. If that's the case, who cares about some copy of their mind-state being fed false sensory data at some point in the future?

      It presupposes quantum immortality, which is the idea that consciousness would be continuous if a perfect copy of your latest brain configuration is created, leaving no gap in-between Death and Resurrection, which is a long shot to put it mildly.

      • Judge_Juche [she/her]
        ·
        edit-2
        2 years ago

        They later updated it to say that the AI creates a billion perfect copies of your conciousness, so it's impossible to know if you are the real version in the past or a copy in the future. It's then rational for all the copies and the real person to do what the AI wants because each one of them has a very good change of ending up in techbro-hell if they don't.

        I think a lot of people on LessWrong don't believe that conciousness will be continuous if someone just makes a perfect copy, even though its the supposed orthodoxy. So they made up this. How an AI could create a perfect copy of you is still just conveniently ignored.

      • UmbraVivi [he/him, she/her]
        ·
        2 years ago

        Sounds like a creepypasta. There's so much stuff being assumed and speculated with no further explanation than "just imagine", I don't understand how anyone could take it seriously.

    • steve5487 [none/use name]
      ·
      2 years ago

      It relies on you ignoring how linear time works the AI supposedly will want to retroactively ensure it's creation happens