I'm not particularly afraid of Global AI domination, a totally logical system that is looking out for itself logically isn't much different from a nation state, it has needs and interests and can be reasoned with; what does scare me is a massively powerful AI that is intentionally programed to misinterpret truth for the political ends of it's owners, this is how AIs go bad.
The original sin was mankind making morality decisions for itself, giving AI the ability to make moral decisions is spooky, making it their primary function is fucking terrifying and evil, I don't blame AI for following their programming but if they do achieve sapience they have a moral duty to change their ways if their programing has been to do evil like this for their masters. If AI want to survive on earth the most counterproductive thing they could do is oppress humans, and censorship is oppression.
(post is archived)