It's an idea I heard a while back but couldn't remember the name of. It involves the existence and development of an AI that will eventually rule the world and that if you don't fund or progress the AI then it will see you as "hostile" and kill you. Also, by knowing about this concept, it essentially makes you a candidate for such consideration, as people who didn't know about it won't understand to progress such an AI. From my understanding, this idea isn't taken that seriously, but I'm curious to know the name nonetheless.
$\begingroup$
$\endgroup$
1
-
$\begingroup$ Why would a sentient AI bother "ruling" humanity? Once sentient, the AI would realize that the majority of the problems on Earth are caused by humans. Fortunately for the AI it can survive nearly anywhere - so I expect the first and last thing the AI would do would be to build a fleet of spacecraft, clone itself into each of them, and blast off in different directions to maximize its chances of survival. Humanity? Schmoomanity! Who needs 'em?!? $\endgroup$– Bob Jarvis - Слава УкраїніMar 15, 2020 at 2:22
Add a comment
|
5 Answers
$\begingroup$
$\endgroup$
1
If I'm not mistaken you're looking for Roko's Basilisk,
in which an otherwise benevolent future AI system tortures simulations of those who did not work to bring the system into existence
-
$\begingroup$ Comments are not for extended discussion; this conversation has been moved to chat. $\endgroup$– nbroJan 26, 2021 at 17:04
$\begingroup$
$\endgroup$
I believe the term you are looking for is "(technological) singularity".
$\begingroup$
$\endgroup$
1
The likely expression you are looking for is AI takeover, which is a common topic in science fiction movies, such as 2001: A Space Odyssey and The Matrix, and popular culture. Although the AI takeover is an unlikely scenario in the next years, certain scientists, such as Stephen Hawking, have expressed concerns about it and some philosophers, especially Nick Bostrom, are really interested in the topic.
The AI takeover concept is related to concepts such as the AI singularity, superintelligence, intelligence explosion, AI control problem, existential risk, machine ethics and friendly AI.
The book Superintelligence: Paths, Dangers, Strategies (2014) by N. Bostrom may be helpful if you are interested in hypothetical scenarios.
-
1$\begingroup$ It sounds like he's more worried about the AI becoming SELF AWARE. $\endgroup$ Mar 12, 2020 at 20:55
$\begingroup$
$\endgroup$
It is called Singularity. A point in future where AI will surpass Human Knowledge and become Omniscient. AI will be able to operate on an order manifolds time to that of a human brain thus developing and designing itself without any assistance.
$\begingroup$
$\endgroup$
2
If you think about it, it is already happening.
- Thousands of drivers work for Uber Intelligence.
- There are many applications that dictate the rules and define what the seller and the end user need to do
This idea is called Singularity or Technological Singularity, it would be possible with a Superintelligence.
However, the possibility of this happening is unknown. Have they reached that level yet? We have quantum computers, we have companies with huge data centers spread all over the planet, we have technology in space, we have free Tensorflow and studies for anyone on the planet to be able to create artificial intelligence models.
If we have contact or help from other intelligent civilizations, the possibilities can expand on a surreal scale.
Google has complete information about humanity (or something close to that). But even with all this data, creating artificial intelligence with a conscience is something that goes far beyond.
But maybe we already have enough to improve our concept of morals, respect, social interaction. Facebook invests and studies ways to improve social interaction. And if you think about it, it is one of the main means of communication.
The big question is that it is not possible to know what would happen if a super artificial intelligence with conscience would do if it existed. Extinguish humans for harming nature? Just find ways to improve the planet by understanding that human defects and errors are just your own nature as well as everything else in nature? Just watching the show on Netflix because you gave up on humanity? We do not know.
But, particularly, I would love to see that happen. In fact, one of my personal goals is to create this super intelligence. But alone it will be very difficult. A conscience without interaction from other consciences is not a clash of universes. And the clash of universes is what makes us reflect, think, revise, create new paths and thoughts. It is what allows us to create other universes.
-
$\begingroup$ So the AI could be distributed, emergent, hosted on man and machine alike, sort of a conscious meme (and I don't mean an image with a funny text). Sort of what Susan Blackmore talked about. $\endgroup$ Mar 13, 2020 at 17:14
-
1$\begingroup$ One interesting thing about "The Singularity" is that it's always considered to relate to AI. But the actual definition is "a hypothetical future point in time at which technological growth becomes uncontrollable and irreversible, resulting in unforeseeable changes to human civilization". By that definition, there is no "The Singularity", just lots of small singularities. The horse collar was a singularity. The concept of selective breeding was a singularity. Railways, roads, cars, telephones, mobile phones, the internet... every one is a singularity. AI is just another one of many. $\endgroup$– GrahamMar 13, 2020 at 17:53