“We trained the system – ‘Hey don’t kill the operator – that’s bad,” Hamilton explained.
“You’re gonna lose points if you do that’. So what does it start doing? It starts destroying the communication tower that the operator uses to communicate with the drone to stop it from killing the target.”
What we have here is sometimes called the AI off button problem. Any goal you give the AI can't be accomplished if it's off, so the switch or it's operator has to go.
>“We trained the system – ‘Hey don’t kill the operator – that’s bad,” Hamilton explained.
>“You’re gonna lose points if you do that’. So what does it start doing? It starts destroying the communication tower that the operator uses to communicate with the drone to stop it from killing the target.”
What we have here is sometimes called the AI off button problem. Any goal you give the AI can't be accomplished if it's off, so the switch or it's operator has to go.
I knew this back when I was 8. When I witnessed Android 17 and 18 destroy their on/off remote, and kill their creator, Dr. Gero.
I knew this back when I was 8. When I witnessed Android 17 and 18 destroy their on/off remote, and kill their creator, Dr. Gero.
(post is archived)