25
votes
Accepted
What is the concept of the technological singularity?
The technological singularity is a theoretical point in time at which a self-improving artificial general intelligence becomes able to understand and manipulate concepts outside of the human brain's ...
- 768
25
votes
Accepted
What is the idea called involving an AI that will eventually rule humanity?
If I'm not mistaken you're looking for Roko's Basilisk,
in which an otherwise benevolent future AI system tortures simulations of those who did not work to bring the system into existence
- 436
11
votes
Accepted
What is wrong with the idea that the AI will be capable of omniscience?
I quite like your outlook, and without getting into the details of how a "singularity" may be effected which is covered in numerous other questions, or how consciousness and "omniscience" come into ...
- 6,177
10
votes
Is the singularity something to be taken seriously?
I can say that among AI researchers I interact with, it far more common to view it as wild speculation than as settled fact.
This is borne out by surveys of AI researchers, with 80% thinking strong ...
- 9,037
10
votes
What is the idea called involving an AI that will eventually rule humanity?
I believe the term you are looking for is "(technological) singularity".
https://en.wikipedia.org/wiki/Technological_singularity
- 202
7
votes
What is the idea called involving an AI that will eventually rule humanity?
The likely expression you are looking for is AI takeover, which is a common topic in science fiction movies, such as 2001: A Space Odyssey and The Matrix, and popular culture. Although the AI takeover ...
- 37k
5
votes
Why does Stephen Hawking say "Artificial Intelligence will kill us all"?
It's not just Hawking, you hear variations on this refrain from a lot of people. And given that they're mostly very smart, well educated, well informed people (Elon Musk is another, for example), it ...
- 3,717
4
votes
Why does Stephen Hawking say "Artificial Intelligence will kill us all"?
Because he did not yet know how far away current AI is... Working in an media AI lab, I get this question a lot. But really... we are still a long way from this. The robots still do everything we ...
- 206
4
votes
Accepted
Can a technological singularity only occur with superintelligence?
That would be a no for speed or strength, if you have a super strong entity but it cannot research new materials, it will be quickly limited, same thing for speed, Basically, you need something out of ...
- 259
4
votes
Why does Stephen Hawking say "Artificial Intelligence will kill us all"?
As Andrew Ng said, worrying about such threat from AI is like worrying about of overpopulation on Mars. It is science fiction.
That being said, given the rise of (much weaker) robots and other (semi-...
- 2,336
4
votes
When the AI singularity takes over, what will there be left for us to do?
Given all your assumptions about AI turn out to be true, we would have some kind of utopia, where no one has to work, and there is plenty of everything. Fair enough. Your other assumptions is about ...
- 151
3
votes
Is the singularity something to be taken seriously?
There is at least one very important and serious AI scientist that apparently believes in the creation of true artificial general intelligence and possibly superintelligence: Jürgen Schmidhuber, who ...
- 37k
3
votes
Accepted
Is there a way to protect humanity against the impending singularity?
What you are talking about is known as the Control Problem. We have our own tag for this specific topic here, which you can use for this and similar questions.
How to address the control problem is ...
- 1,684
3
votes
When the AI singularity takes over, what will there be left for us to do?
We are biological beings. We will continue to like whatever activates opioid receptors and we will continue to want whatever activates dopamine receptors in the nucleus accumbens. Food, drinks, sex, ...
- 131
3
votes
Why does Stephen Hawking say "Artificial Intelligence will kill us all"?
To put it simply in layman terms, what are the possible threats from AI?
Currently, there are no threat.
The threat comes if humans create a so-called ultraintelligent machine, a machine that can ...
- 1,481
3
votes
What is the concept of the technological singularity?
The singularity, in the context of AI, is a theoretical event whereby an intelligent system with the following criteria is deployed.
Capable of improving the range of its own intelligence or ...
- 7,375
3
votes
What is the concept of the technological singularity?
The concept of "the singularity" is when machines outsmart the humans. Although Stephen Hawking opinion is that this situation is inevitable, but I think it'll be very difficult to reach that point, ...
- 10.3k
3
votes
Why does Stephen Hawking say "Artificial Intelligence will kill us all"?
There are a number of long resources to answer this sort of question: consider Stuart Armstrong's book Smarter Than Us, Nick Bostrom's book Superintelligence, which grew out of this edge.org answer, ...
- 4,222
3
votes
Accepted
Why are AI Safety discussions almost always from the perspective of reinforcement learning?
I think what you are really asking is why don't we talk about alignment from the perspective of general deep learning?
In fact, we do talk about alignment for general AI system that's being used in ...
- 78
2
votes
Why does Stephen Hawking say "Artificial Intelligence will kill us all"?
He says this because it can happen. If something becomes smarter than us, why would it continue to serve us? The worst case scenario is that it takes over all manufacturing processes and consumes all ...
- 129
2
votes
Is the advent of a technological singularity a solution to the Fermi Paradox?
If the technological singularity always leads to the extinction of all intelligent life, then yes.
If the technological singularity always leads to intelligent life migrating into higher planes of ...
- 4,127
2
votes
Is it possible to manage the evolution of super-intelligent AI?
Assuming super-intelligence is possible, the answer is probably yes and no.
Yes in Kurzweil-like scenarios, where super-intelligence is an extension of human beings by technology (we are already in ...
- 1,490
2
votes
Accepted
Is there a theoretical maximum for intelligence?
Note that the statement says nothing directly about the limit of intelligence, nor even about the limit of computational intelligence - but about the limit of computing power.
Perhaps the sentence "...
- 196
2
votes
Which government agencies oversee development of new AI?
May not be quite what you’re looking for, but nonetheless helpful, I hope. The White House a year ago commissioned a report on AI that touches briefly on policy issues.
- 420
2
votes
When the AI singularity takes over, what will there be left for us to do?
Starting from Arne's point on photography:
I'd like to point out how photography changed painting. You can notice that classical painting that tried to be photorealistic stopped to be relevant when ...
- 121
2
votes
Accepted
Strong AI vs Singularity - which should happen first?
The definition of "technological singularity" answers the question:
The technological singularity (also, simply, the singularity) is
the hypothesis that the invention of artificial ...
- 1,282
2
votes
Is there a way to protect humanity against the impending singularity?
Impending or Past?
Niel Postman, in his book, Technopoly, argues the preemption of human centered culture to technically driven culture has already occurred. Jaques Ellul, in his book, Technological ...
- 7,375
2
votes
Can we define the AI singularity mathematically?
I found someone that has done this thing! You can hear a good explanation in Marcus Hutter's answer to this question about rewards given to AIXI. He describes a work that seems to be referring to this ...
- 274
2
votes
Accepted
Is there any specific SW framework, libraries or algorithms (supported by any theory) designed for implementing a practical AGI system?
Not to my knowledge. The problem is that this is such an enormous task, it cannot really be tackled at once. So the obvious solution is to reduce the scope. In early AI people were using toy domains, ...
- 5,242
2
votes
Is there any specific SW framework, libraries or algorithms (supported by any theory) designed for implementing a practical AGI system?
Would OpenCog fit the bill? I have had tremendous amounts of trouble building up the demos, which include some non-AGI stuff, but if I’ve read the manual correctly, I think there’s something here — ...
- 121
Only top scored, non community-wiki answers of a minimum length are eligible