Five individuals versed in AI offer up chilling accounts of the very real, and fast ways that AI could marginalize humans to the point of extinction. Read the article for full story. Not Hyperbole.

Way 1: ‘If we become the less intelligent species, we should expect to be wiped out’ - It has happened many times before that species were wiped out by others that were smarter. We humans have already wiped out a significant fraction of all the species on Earth. That is what you should expect to happen as a less intelligent species – which is what we are likely to become, given the rate of progress of artificial intelligence. The tricky thing is, the species that is going to be wiped out often has no idea why or how.

Way 2: ‘The harms already being caused by AI are their own type of catastrophe’ - The worst-case scenario is that we fail to disrupt the status quo, in which very powerful companies develop and deploy AI in invisible and obscure ways. As AI becomes increasingly capable, and speculative fears about far-future existential risks gather mainstream attention, we need to work urgently to understand, prevent and remedy present-day harms.

Way 3: ‘It could want us dead, but it will probably also want to do things that kill us as a side-effect’ - It’s much easier to predict where we end up than how we get there. Where we end up is that we have something much smarter than us that doesn’t particularly want us around. If it’s much smarter than us, then it can get more of whatever it wants. First, it wants us dead before we build any more superintelligences that might compete with it. Second, it’s probably going to want to do things that kill us as a side-effect, such as building so many power plants that run off nuclear fusion – because there is plenty of hydrogen in the oceans – that the oceans boil.

Way 4: ‘If AI systems wanted to push humans out, they would have lots of levers to pull’ - The trend will probably be towards these models taking on increasingly open-ended tasks on behalf of humans, acting as our agents in the world. The culmination of this is what I have referred to as the “obsolescence regime”: for any task you might want done, you would rather ask an AI system than ask a human, because they are cheaper, they run faster and they might be smarter overall. In that endgame, humans that don’t rely on AI are uncompetitive. Your company won’t compete in the market economy if everybody else is using AI decision-makers and you are trying to use only humans. Your country won’t win a war if the other countries are using AI generals and AI strategists and you are trying to get by with humans.

Way 5: ‘The easiest scenario to imagine is that a person or an organisation uses AI to wreak havoc’ - A large fraction of researchers think it is very plausible that, in 10 years, we will have machines that are as intelligent as or more intelligent than humans. Those machines don’t have to be as good as us at everything; it’s enough that they be good in places where they could be dangerous. The easiest scenario to imagine is simply that a person or an organisation intentionally uses AI to wreak havoc. To give an example of what an AI system could do that would kill billions of people, there are companies that you can order from on the web to synthesise biological material or chemicals. We don’t have the capacity to design something really nefarious, but it’s very plausible that, in a decade’s time, it will be possible to design things like this. This scenario doesn’t even require the AI to be autonomous.

  • DiltoGeggins [none/use name]
    hexagon
    ·
    1 year ago

    No, you're just proving my point because you made a hollow, pithy rejoinder that did nothing to further the conversation along. You provided nothing more than the typical, "Ah disagree wiff you!!" And I just thought it was humorous in an ironic, low key way. Tanks for the laff!

    • DictatrshipOfTheseus [comrade/them, any]
      ·
      1 year ago

      Wow. Chip on your shoulder or something?

      First of all, even if it were true that my comment was nothing more than a "hollow, pithy rejoinder," it wouldn't "prove" your "point" - which is what, by the way? That evolution somehow discredits a link between empathy and intelligence? This is just factually wrong. And it's weird that you would say that your point is being proven by the existence of a person who doesn't have a lot of empathy or intelligence. If you want to take the reality of a link between intelligence and empathy down to an individual scale (which isn't what was even being discussed) then such a person would actually be a mark against your point.

      If my comment did "nothing to further the conversation along" then what did your essentially telling Dirt_Owl "nice thought but too bad you aren't accounting for reality and evolution" add to the discussion? Nothing. You were just writing off their perfectly valid point as if "reality" says otherwise. You know who could further this conversation along? Peter Kropotkin. Try reading Peter Kropotkin's Mutual Aid: A factor of Evolution.

      Glad I made you laugh I guess, but I think it's painfully clear where the irony is in this little discussion and it's not where you seem to think it is. "Cheers."

      • UlyssesT
        ·
        edit-2
        1 month ago

        Removed by mod

        • DictatrshipOfTheseus [comrade/them, any]
          ·
          edit-2
          1 year ago

          I recognized their name enough to remember that there was some... questionable... stuff they posted before, but also some posts that seemed genuine enough and produced some interesting threads. After this, let's just say I'm not going to be giving them the benefit of the doubt as easily as I was.

          I had no idea what teaboo meant until I just now looked it up (thanks for teaching me a new slang word comrade). Yeah, that could for sure fit. I'm not british but I have actually signed off with "cheers" before. I always intended it with kind sincerity though. Guess I won't be doing that anymore. sadness

          Anyway, thanks in general for fighting the good fight against the incessant reddit-logo bazinga edgelord shit that slimes its way onto hexbear so much. I know it can sometimes be an uphill battle, but fwiw, you have fans (like me) on the sidelines hoping their upvotes are enough to show their appreciation of you.

          • UlyssesT
            ·
            edit-2
            1 month ago

            deleted by creator

    • UlyssesT
      ·
      edit-2
      1 month ago

      deleted by creator