• 47 Alpha Tango@lemmy.zip
    ·
    11 months ago

    The biggest issue is that when the AI reports to its masters that Olga has only made 3 cups and they fire her it will be assumed that the AI is infallible and no matter how much she protests she will be assumed to be in the wrong.

    I’m sure a database of which companies do this sort of thing will appear online eventually and people will need to not furnish these companies with their patronage. It’s the only way to stop it.

    • SootyChimney [any]
      ·
      edit-2
      11 months ago

      This is already a modern hellscape scenario that happens. Check out the UK postmaster scandal, a piece of software said that >100 postmasters across the country were stealing money. They all protested their innocence. Many were imprisoned for decades. Many committed suicide over it. Years afterward, they realised the software might be faulty, and didn't say anything. Only recently did they have to admit that it was probably a bug.

      • UlyssesT [he/him]
        ·
        edit-2
        11 months ago

        The quasi-religious belief that technology can not make mistakes and somehow lacks the biases of those that make it and program it continues to fuck us all.

      • redtea@lemmygrad.ml
        ·
        11 months ago

        Those postmasters got screwed! Some remortgaged their homes, all sorts, to pay what the computer said was missing from the till.

    • bigboopballs [he/him]
      ·
      11 months ago

      people will need to not furnish these companies with their patronage. It’s the only way to stop it.

      now that's what I call powerlessness