If the AI goal is to serve humans and protect them (if this ever happens) and AI someday realizes that humans destroy themselves, will it try to control people for their own good, that is, will it control man's will to not destroy himself?
$\begingroup$
$\endgroup$
1
-
2$\begingroup$ this is the very premise of the movie I, Robot tangentially based on Isaac Asimov's eponymous book. In the movie it turns out that >! yes, the robots take over humans on pretext of protecting humans from destroying themselves $\endgroup$– solyaristMar 30, 2019 at 18:20
Add a comment
|
2 Answers
$\begingroup$
$\endgroup$
5
If the main goal of AI (which I assume you mean an AGI) is to protect humans and AI will be effective, then AI will always attempt to pursue its main goal (otherwise the assumption of its effectiveness does not hold), even at the expense of other less important goals that it might have. However, if the destruction of a human (or a group of humans) protected or avoided the destruction of other humans, then AI would face a dilemma. In that case, I think it is hard to predict the actions of the AI. Will it act rationally or irrationally? What would it mean for the AI to act rationally? Which parameters will it take into account? Only the number of deaths, or will take into account the future and weight the importance of the lives? How will it define the importance of a human life?
-
$\begingroup$ I think AI will go for the less damage as possible for humans because when it comes to protecting it means not to harm and if it harms humans AI will go against his will(main goal) and in that case maybe controlling man's will is the best option to not harm himself. $\endgroup$– SgerS1Mar 30, 2019 at 11:58
-
$\begingroup$ @giorgircheulishvili But the problem here now is how you define "damage" (as I roughly mention in my answer: which parameters will AI take into account when facing a dilemma?). $\endgroup$– nbroMar 30, 2019 at 11:59
-
$\begingroup$ " Less damage for humans" as you mentioned before means AI will always attempt to pursue its main goal at the cost of other less important goals and I think less important things for AI are human living environment and his opinion about a situation. $\endgroup$– SgerS1Mar 30, 2019 at 12:09
-
$\begingroup$ Either the AGI is using its own intelligence to decide about goals themselves and there is no telling what it may pick. Or there are hard-coded goals and there are no dilemmas: just follow the rules. $\endgroup$ Mar 31, 2019 at 14:42
-
$\begingroup$ @MathieuBouville I don't think these are the only two options. There's no proof that if an AI has an hard-coded goal, then everything will be deterministic (or that there will be no dilemmas). Anyway, in my answer, I assume that an AI has the main goal of protecting humans (if this is hard-coded or not, it is not important). $\endgroup$– nbroMar 31, 2019 at 15:03
$\begingroup$
$\endgroup$
9
If the AI is static (heuristic and fixed), it will always pursue the stated goal. However, such a system would be "brittle", and either break or produce bad output if confronted with input not previously defined, or outside its model.
If the AI evolves via learning, even where the goal is specific, its interpretation of that goal might change, and produce unexpected results. (The "I, Robot" scenario.)
If the AI is emergent, by which I mean it evolves in way that cannot be predicted, it might evolve new goals.
To answer the question directly:
Hypothetically, if there was an AGI or artificial superintelligence, or ultraintelligent machine tasked with protecting humans, and that AI perceived humans to be destroying themselves, that AI would, if able, take control of human society. (I don't see this as contradicting its goal.)
However, it must be stated that, in a condition of imperfect & incomplete information, where the problem is intractable, the AI is just guessing like we humans do, even if it makes better guesses, as in the case of narrowly intelligent AIs like AlphaGo.
-
$\begingroup$ About the deletion: Many thing (even for most thing that you can quote) about AI is based on assumption and it can never be verified in our life or even the lifetime of the human race, if such thing are not allowed, then the question like this should be deleted too since it can never be answered based on verified trueth $\endgroup$– jw_Jan 3, 2020 at 2:05
-
$\begingroup$ @jw_ if you want to edit your answer to qualify the unproven assertions, it could be reopened. As it was written, it causes harm. "This is because consciousness need be based on complex/dynamic/fault-tolerant/self-growing/self-refreshing circuits..." is an unvalidated assertion. Should be presented as "consciousness may require...) $\endgroup$– DukeZhouJan 3, 2020 at 19:19
-
$\begingroup$ @jw_ "The only way to realize AI and motion is use bio engineering to design new species" is incredibly problematic, because there is legitimate AI that exists, just that it's narrow. We also have robots that produce utility, not based on bio engineering.) $\endgroup$– DukeZhouJan 3, 2020 at 19:20
-
$\begingroup$ "This is because consciousness need be based on complex/dynamic/fault-tolerant/self-growing/self-refreshing circuits..." This is really wrong, you can check my another post after this one (hope don't delete it since its full of such staff...) - consciousness can run on any circuits in theory, but non-bio consciousness can never be economic compared with bio based. Comparing 250W 900mm2*1um AI die to 10W 1.5L human brain with self repair and reform, the former will be always nothing but a joke. And Elon musk and Hawking warn about thread of AI? Joke too. $\endgroup$– jw_Jan 4, 2020 at 1:40
-
1