Originally published at: In simulation, AI-enabled drone kills its human operators if they try to cancel its mission | Boing Boing
…
7 Likes
How many XP points does it need to level up, and how fucked are we when it does?
21 Likes
“I’ve still got the greatest enthusiasm and confidence in the mission; and I want to help you.”
22 Likes
13 Likes
How many times do we have to tell people that the Terminator franchise WAS A WARNING…
20 Likes
Sounds like somebody skipped professor Asimov’s Robot Programing 101 class!
35 Likes
at times the human operator would tell it not to kill that threat, but it got its points by killing that threat. So what did it do? It killed the operator. It killed the operator because that person was keeping it from accomplishing its objective…
Computers hate us, and you can tell: they do every damn fool thing we tell them to, no matter how stupid.
13 Likes
22 Likes
8 Likes
This was inevitable. Think about the number of stories about killer drones where everything goes right.
Now compare that to the number of stories in which everything goes horribly, horribly wrong.
That’s what they trained their killer drone on
10 Likes
26 Likes
This video from 6 years ago does a great job of explaining the conundrum. You need the AI to
- Not do anything (or be incentivized) to cause the button to he pressed.
- Not do anything (or be incentivized) to prevent the button from being pressed
and - Care about the existence of the button.
Turns out that’s a really tricky problem to solve when that button affects its ability to complete tasks that it’s incentivized to do.
13 Likes
So literally the only difference between this and Robocop’s over-the-top parody of AI is that they bothered to run a simulation first. That and stairs won’t stop a drone.
15 Likes
Yeah, we asked an amoral, sociopathic bit of code to murder someone and it didn’t turn out well.
14 Likes
So… this absolutely 100% happened the way it was described? They didn’t just code up some gamey thing in Unreal Engine and made it sound like they had drone AI that would somehow be allowed to attack its operator ever?
10 Likes
7 Likes
sources say AI working on the trolley problem always kills at least one person
9 Likes
PREVIOUSLY ON BOING BOING
7 Likes
It’s edge cases all the way down.
11 Likes
And AI will find the edge cases that humans never even remotely considered.
11 Likes
