25 votes
Accepted

What is the concept of the technological singularity?

The technological singularity is a theoretical point in time at which a self-improving artificial general intelligence becomes able to understand and manipulate concepts outside of the human brain's ...
user avatar
  • 758
25 votes
Accepted

What is the idea called involving an AI that will eventually rule humanity?

If I'm not mistaken you're looking for Roko's Basilisk, in which an otherwise benevolent future AI system tortures simulations of those who did not work to bring the system into existence
user avatar
  • 426
10 votes

Is the singularity something to be taken seriously?

I can say that among AI researchers I interact with, it far more common to view it as wild speculation than as settled fact. This is borne out by surveys of AI researchers, with 80% thinking strong ...
user avatar
10 votes
Accepted

What is wrong with the idea that the AI will be capable of omniscience?

I quite like your outlook, and without getting into the details of how a "singularity" may be effected which is covered in numerous other questions, or how consciousness and "omniscience" come into ...
user avatar
  • 6,067
10 votes

What is the idea called involving an AI that will eventually rule humanity?

I believe the term you are looking for is "(technological) singularity". https://en.wikipedia.org/wiki/Technological_singularity
user avatar
  • 202
6 votes

What is the idea called involving an AI that will eventually rule humanity?

The likely expression you are looking for is AI takeover, which is a common topic in science fiction movies, such as 2001: A Space Odyssey and The Matrix, and popular culture. Although the AI takeover ...
user avatar
  • 34.5k
5 votes

Why does Stephen Hawking say "Artificial Intelligence will kill us all"?

It's not just Hawking, you hear variations on this refrain from a lot of people. And given that they're mostly very smart, well educated, well informed people (Elon Musk is another, for example), it ...
user avatar
  • 3,697
4 votes

Why does Stephen Hawking say "Artificial Intelligence will kill us all"?

Because he did not yet know how far away current AI is... Working in an media AI lab, I get this question a lot. But really... we are still a long way from this. The robots still do everything we ...
user avatar
  • 204
4 votes
Accepted

Can a technological singularity only occur with superintelligence?

That would be a no for speed or strength, if you have a super strong entity but it cannot research new materials, it will be quickly limited, same thing for speed, Basically, you need something out of ...
user avatar
  • 249
4 votes

Why does Stephen Hawking say "Artificial Intelligence will kill us all"?

As Andrew Ng said, worrying about such threat from AI is like worrying about of overpopulation on Mars. It is science fiction. That being said, given the rise of (much weaker) robots and other (semi-...
user avatar
4 votes

When the AI singularity takes over, what will there be left for us to do?

Given all your assumptions about AI turn out to be true, we would have some kind of utopia, where no one has to work, and there is plenty of everything. Fair enough. Your other assumptions is about ...
user avatar
  • 151
3 votes

Is the singularity something to be taken seriously?

There is at least one very important and serious AI scientist that apparently believes in the creation of true artificial general intelligence and possibly superintelligence: Jürgen Schmidhuber, who ...
user avatar
  • 34.5k
3 votes
Accepted

Is there a way to protect humanity against the impending singularity?

What you are talking about is known as the Control Problem. We have our own tag for this specific topic here, which you can use for this and similar questions. How to address the control problem is ...
user avatar
  • 1,644
3 votes

When the AI singularity takes over, what will there be left for us to do?

We are biological beings. We will continue to like whatever activates opioid receptors and we will continue to want whatever activates dopamine receptors in the nucleus accumbens. Food, drinks, sex, ...
user avatar
  • 131
3 votes

Why does Stephen Hawking say "Artificial Intelligence will kill us all"?

To put it simply in layman terms, what are the possible threats from AI? Currently, there are no threat. The threat comes if humans create a so-called ultraintelligent machine, a machine that can ...
user avatar
  • 1,461
3 votes

What is the concept of the technological singularity?

The concept of "the singularity" is when machines outsmart the humans. Although Stephen Hawking opinion is that this situation is inevitable, but I think it'll be very difficult to reach that point, ...
user avatar
  • 10.1k
3 votes

Why does Stephen Hawking say "Artificial Intelligence will kill us all"?

There are a number of long resources to answer this sort of question: consider Stuart Armstrong's book Smarter Than Us, Nick Bostrom's book Superintelligence, which grew out of this edge.org answer, ...
user avatar
3 votes
Accepted

Why are AI Safety discussions almost always from the perspective of reinforcement learning?

I think what you are really asking is why don't we talk about alignment from the perspective of general deep learning? In fact, we do talk about alignment for general AI system that's being used in ...
user avatar
2 votes

Why does Stephen Hawking say "Artificial Intelligence will kill us all"?

He says this because it can happen. If something becomes smarter than us, why would it continue to serve us? The worst case scenario is that it takes over all manufacturing processes and consumes all ...
user avatar
  • 129
2 votes

Is the advent of a technological singularity a solution to the Fermi Paradox?

If the technological singularity always leads to the extinction of all intelligent life, then yes. If the technological singularity always leads to intelligent life migrating into higher planes of ...
user avatar
2 votes

Is it possible to manage the evolution of super-intelligent AI?

Assuming super-intelligence is possible, the answer is probably yes and no. Yes in Kurzweil-like scenarios, where super-intelligence is an extension of human beings by technology (we are already in ...
user avatar
  • 1,480
2 votes
Accepted

Is there a theoretical maximum for intelligence?

Note that the statement says nothing directly about the limit of intelligence, nor even about the limit of computational intelligence - but about the limit of computing power. Perhaps the sentence "...
user avatar
2 votes

Which government agencies oversee development of new AI?

May not be quite what you’re looking for, but nonetheless helpful, I hope. The White House a year ago commissioned a report on AI that touches briefly on policy issues.
user avatar
2 votes

When the AI singularity takes over, what will there be left for us to do?

Starting from Arne's point on photography: I'd like to point out how photography changed painting. You can notice that classical painting that tried to be photorealistic stopped to be relevant when ...
user avatar
2 votes
Accepted

Strong AI vs Singularity - which should happen first?

The definition of "technological singularity" answers the question: The technological singularity (also, simply, the singularity) is the hypothesis that the invention of artificial ...
user avatar
2 votes

Can we define the AI singularity mathematically?

I found someone that has done this thing! You can hear a good explanation in Marcus Hutter's answer to this question about rewards given to AIXI. He describes a work that seems to be referring to this ...
user avatar
  • 259
2 votes
Accepted

Is there any specific SW framework, libraries or algorithms (supported by any theory) designed for implementing a practical AGI system?

Not to my knowledge. The problem is that this is such an enormous task, it cannot really be tackled at once. So the obvious solution is to reduce the scope. In early AI people were using toy domains, ...
user avatar
  • 5,062
2 votes

Is there any specific SW framework, libraries or algorithms (supported by any theory) designed for implementing a practical AGI system?

Would OpenCog fit the bill? I have had tremendous amounts of trouble building up the demos, which include some non-AGI stuff, but if I’ve read the manual correctly, I think there’s something here — ...
user avatar

Only top scored, non community-wiki answers of a minimum length are eligible