33

tl;dr There are many valid reasons why people might fear (or better be concerned about) AI, not all involve robots and apocalyptic scenarios. To better illustrate these concerns, I'll try to split them into three categories. Conscious AI This is the type of AI that your question is referring to. A super-intelligent conscious AI that will destroy/enslave ...


13

Short term Physical accidents, e.g. due to industrial machinery, aircraft autopilot, self-driving cars. Especially in the case of unusual situations such as extreme weather or sensor failure. Typically an AI will function poorly under conditions where it has not been extensively tested. Social impacts such as reducing job availability, barriers for the ...


8

In addition to the other answers, I would like to add to nuking cookie factory example: Machine learning AIs basically try to fulfill a goal described by humans. For example, humans create an AI running a cookie factory. The goal they implement is to sell as many cookies as possible for the highest profitable margin. Now, imagine an AI which is ...


8

My favorite scenario for harm by AI involves not high intelligence, but low intelligence. Specifically, the grey goo hypothesis. This is where a self-replicating, automated process runs amok and converts all resources into copies of itself. The point here is that the AI is not "smart" in the sense of having high intelligence or general intelligence--it ...


5

I have an example which goes in kinda the opposite direction of the public's fears, but is a very real thing, which I already see happening. It is not AI-specific, but I think it will get worse through AI. It is the problem of humans trusting the AI conclusions blindly in critical applications. We have many areas in which human experts are supposed to make ...


5

I would say the biggest real threat would be the unbalancing/disrupting we are already seeing. The changes of putting 90% the country out of work are real, and the results (which will be even more uneven distribution of wealth) are terrifying if you think them through.


4

Will Artificial Intelligence some day become a problem to humanity after learning human behaviors and characteristics? It can be answered in both ways, I think. Yes, they may become a problem. With the increasing integration of loads of apps and smart devices in our life, almost everything defining an individual human being is digitalised. For instance, ...


4

This only intents to be a complement to other answers so I will not discuss to possibility of AI trying to willingly enslave humanity. But a different risk is already here. I would call it unmastered technology. I have been teached science and technology, and IMHO, AI has by itself no notion of good and evil, nor freedom. But it is built and used by human ...


4

This has been studied pretty well academically. The most common study instrument is a survey of the opinions of AI researchers. The other mechanism is subjective assessment by business analysts about which sectors are most likely to be automated, using two criteria: ease of automation, and potential profit from automation (based on the size of the workforce)....


4

My understanding of Neo-Luddism is that it is concerned with the unforeseeable effects of technology. The "blackening of London" (see Blake's London) in the early industrial era was an unforeseen effect, and would have had impacts on health related to air quality. The unforeseen effect of heavy use of plastic materials has led not only to a large amount of ...


3

I think one of the most real (ie. related to current, existing AIs) risks are in blindly relying on unsupervised AIs, for two reasons. 1. AI systems may degrade Physical error in AI systems may start producing wildly wrong results in regions in which they were not tested for because the physical system starts providing wrong values. This is sometimes ...


3

The reason this is hard is because it is not trivial to understand what a law means. Many humans still have a hard time understanding laws and thus we have millions of judges and lawyers who study years to be able to even debate whether a law was broken at all. More generally to AI, the problem of understanding laws is a byproduct of the bigger problem that ...


2

Impending or Past? Niel Postman, in his book, Technopoly, argues the preemption of human centered culture to technically driven culture has already occurred. Jaques Ellul, in his book, Technological Society, heaped evidence behind the proposal that technology became autonomous centuries ago. Their arguments are convincing. Some think other criteria must ...


1

In addtion to the many answers already provided, I would bring up the issue of adversarial examples in the area of image models. Adversarial examples are images that have been perturbed with specifically designed noise that is often imperceptible to a human observer, but strongly alters the prediction of a model. Examples include: Affecting the predicted ...


1

Human beings currently exist in an ecological-economic niche of "the thing that thinks". AI is also a thing that thinks, so it will be invading our ecological-economic niche. In both ecology and economics, having something else occupy your niche is not a great plan for continued survival. How exactly Human survival is compromised by this is going to be ...


1

If a robot is similar to a human machine interface the device is the same like a remote controlled car. It's possible to discuss with the operator behind the joystick and negotiate about a wishful behavior. Remote controlled robots are safe inventions because their actions can be traced back to humans and their motivation can be anticipated. They can be used ...


1

I don't like to be a killjoy, but this question seems premature (that's why it's hd the "mythology of AI" tag added to it). The kinds of emergent artificial general intelligence depicted in the movies you mention are in science fiction films because they are science fiction. Most AI researchers do not think they are likely to appear anytime soon. The ...


1

Neither AI alignment nor AI governance are important yet. We are so far away from AGI that we don't even know what is missing. We don't set up safety instructions for interstellar travel, so why should we do it for AGI? I can also come up with a lot of dangers of that... There are real dangers of AI, though. Including societal issues: Blind trust: ...


1

I highly suggest you read Hannu Rajaneimi's Quantum Thief trilogy, William Gibson's Neuromancer trilogy, and Phillip K. Dick's Do Android's Dream of Electric Sheep, Isaac Asimov's I, Robot. It's a nuanced subject, and no one knows. The most credible scenarios I've found for the destruction of humanity by automata involves not high-intelligence, but very ...


1

What you are talking about is known as the Control Problem. We have our own tag for this specific topic here, which you can use for this and similar questions. How to address the control problem is heavily discussed and still considered unsolved. Two of the important approaches are motivation control and capability control. Motivation control aims at ...


Only top voted, non community-wiki answers of a minimum length are eligible