50

tl;dr There are many valid reasons why people might fear (or better be concerned about) AI, not all involve robots and apocalyptic scenarios. To better illustrate these concerns, I'll try to split them into three categories. Conscious AI This is the type of AI that your question is referring to. A super-intelligent conscious AI that will destroy/enslave ...


15

Short term Physical accidents, e.g. due to industrial machinery, aircraft autopilot, self-driving cars. Especially in the case of unusual situations such as extreme weather or sensor failure. Typically an AI will function poorly under conditions where it has not been extensively tested. Social impacts such as reducing job availability, barriers for the ...


9

In addition to the other answers, I would like to add to nuking cookie factory example: Machine learning AIs basically try to fulfill a goal described by humans. For example, humans create an AI running a cookie factory. The goal they implement is to sell as many cookies as possible for the highest profitable margin. Now, imagine an AI which is ...


8

My favorite scenario for harm by AI involves not high intelligence, but low intelligence. Specifically, the grey goo hypothesis. This is where a self-replicating, automated process runs amok and converts all resources into copies of itself. The point here is that the AI is not "smart" in the sense of having high intelligence or general intelligence--it ...


6

I have an example which goes in kinda the opposite direction of the public's fears, but is a very real thing, which I already see happening. It is not AI-specific, but I think it will get worse through AI. It is the problem of humans trusting the AI conclusions blindly in critical applications. We have many areas in which human experts are supposed to make ...


5

The reason this is hard is because it is not trivial to understand what a law means. Many humans still have a hard time understanding laws and thus we have millions of judges and lawyers who study years to be able to even debate whether a law was broken at all. More generally to AI, the problem of understanding laws is a byproduct of the bigger problem that ...


5

This only intents to be a complement to other answers so I will not discuss to possibility of AI trying to willingly enslave humanity. But a different risk is already here. I would call it unmastered technology. I have been teached science and technology, and IMHO, AI has by itself no notion of good and evil, nor freedom. But it is built and used by human ...


5

I would say the biggest real threat would be the unbalancing/disrupting we are already seeing. The changes of putting 90% the country out of work are real, and the results (which will be even more uneven distribution of wealth) are terrifying if you think them through.


4

Will Artificial Intelligence some day become a problem to humanity after learning human behaviors and characteristics? It can be answered in both ways, I think. Yes, they may become a problem. With the increasing integration of loads of apps and smart devices in our life, almost everything defining an individual human being is digitalised. For instance, ...


4

This has been studied pretty well academically. The most common study instrument is a survey of the opinions of AI researchers. The other mechanism is subjective assessment by business analysts about which sectors are most likely to be automated, using two criteria: ease of automation, and potential profit from automation (based on the size of the workforce)....


4

My understanding of Neo-Luddism is that it is concerned with the unforeseeable effects of technology. The "blackening of London" (see Blake's London) in the early industrial era was an unforeseen effect, and would have had impacts on health related to air quality. The unforeseen effect of heavy use of plastic materials has led not only to a large amount of ...


4

I think one of the most real (ie. related to current, existing AIs) risks are in blindly relying on unsupervised AIs, for two reasons. 1. AI systems may degrade Physical error in AI systems may start producing wildly wrong results in regions in which they were not tested for because the physical system starts providing wrong values. This is sometimes ...


3

The biggest risk is algorithmic bias. As more and more decision-making processes are taken on by AI systems, there will be an abdication of responsibility to the computer; people in charge will simply claim the computer did it, and they cannot change it. The real problem is that training data for machine learning often contains bias, which is usually ...


2

Impending or Past? Niel Postman, in his book, Technopoly, argues the preemption of human centered culture to technically driven culture has already occurred. Jaques Ellul, in his book, Technological Society, heaped evidence behind the proposal that technology became autonomous centuries ago. Their arguments are convincing. Some think other criteria must ...


2

What you are talking about is known as the Control Problem. We have our own tag for this specific topic here, which you can use for this and similar questions. How to address the control problem is heavily discussed and still considered unsolved. Two of the important approaches are motivation control and capability control. Motivation control aims at ...


2

Human beings currently exist in an ecological-economic niche of "the thing that thinks". AI is also a thing that thinks, so it will be invading our ecological-economic niche. In both ecology and economics, having something else occupy your niche is not a great plan for continued survival. How exactly Human survival is compromised by this is going to be ...


2

One risk that’s already realized: large online vendors think they have implemented artificial intelligence in their “help” pages and therefore they can (try to) make it impossible to get to someone who can actually think. And since the artificial stupidity (AS) usually feeds the customer articles completely unrelated to the issue, anyone sufficiently ...


1

Offloading of responsibility may the single greatest danger. Where algorithmic bias may be the core issue of Machine Learning, it can be identified and mitigated. Transferring responsibility to a robot or algorithm requires an intentional choice with moral dimension. As the scholar Joanna Bryson put it: In humans consciousness and ethics are ...


1

IMHO the greatest risk is that AI can make people lazy. If you can ask an AI for an answer to any problem, what's your motivation to figure out how to figure out the answer for yourself? I have run into a lot of young people who can't add or multiply two three-digit numbers without using a calculator. When it's possible to dump a huge mass of data into an ...


1

In addtion to the many answers already provided, I would bring up the issue of adversarial examples in the area of image models. Adversarial examples are images that have been perturbed with specifically designed noise that is often imperceptible to a human observer, but strongly alters the prediction of a model. Examples include: Affecting the predicted ...


1

AI that is used to solve a real world problem could pose a risk to humanity and doesn't exactly require sentience, this also requires a degree of human stupidity too.. Unlike humans, an AI would find the most logical answer without the constraint of emotion, ethics, or even greed... Only logic. Ask this AI how to solve a problem that humans created (for ...


1

I highly suggest you read Hannu Rajaneimi's Quantum Thief trilogy, William Gibson's Neuromancer trilogy, and Phillip K. Dick's Do Android's Dream of Electric Sheep, Isaac Asimov's I, Robot. It's a nuanced subject, and no one knows. The most credible scenarios I've found for the destruction of humanity by automata involves not high-intelligence, but very ...


1

I don't like to be a killjoy, but this question seems premature (that's why it's hd the "mythology of AI" tag added to it). The kinds of emergent artificial general intelligence depicted in the movies you mention are in science fiction films because they are science fiction. Most AI researchers do not think they are likely to appear anytime soon. The ...


1

This is a very, very controversial topic. But here's my opinion on the topic: AI won't harm humanity (at least, to the level that a lot of people think it will). As Kartik mentioned in his answer, AGI (Artificial General Intelligence) is the concept of AI that's become so "generally" intelligent, that it can do everything we as humans can, and more, but do ...


1

Neither AI alignment nor AI governance are important yet. We are so far away from AGI that we don't even know what is missing. We don't set up safety instructions for interstellar travel, so why should we do it for AGI? I can also come up with a lot of dangers of that... There are real dangers of AI, though. Including societal issues: Blind trust: ...


1

Predicting what happens post-singularity is simply not possible as we cannot attempt to model let alone conceptualise a mind far more complex than ours. If that is a difficult concept to get your head around, consider how far an insect's central nervous system could go in understanding human behaviour. That fact alone is an argument against the likelihood ...


1

More likely as a result after the test every human needs to go truh... And if it’s successful you will reach the next level (The real world after the “virtual reality” we are living in now).


Only top voted, non community-wiki answers of a minimum length are eligible