14
$\begingroup$

It's an idea I heard a while back but couldn't remember the name of. It involves the existence and development of an AI that will eventually rule the world and that if you don't fund or progress the AI then it will see you as "hostile" and kill you. Also, by knowing about this concept, it essentially makes you a candidate for such consideration, as people who didn't know about it won't understand to progress such an AI. From my understanding, this idea isn't taken that seriously, but I'm curious to know the name nonetheless.

$\endgroup$
  • 7
    $\begingroup$ Now let's see how many people you've doomed by posting this. Currently the count is at 269. $\endgroup$ – probably_someone Mar 12 at 22:27
  • 1
    $\begingroup$ @probably_someone Now, how many people named Dave were doomed? $\endgroup$ – Mindwin Mar 13 at 19:40
  • $\begingroup$ Aragorn's heartfelt order at Helm's Deep - too late then and probably too late for you - seems apposite - "Kill him! Kill him !!!" [At one minute in, but it must be time to watch it again :-) ]. $\endgroup$ – Russell McMahon Mar 14 at 11:15
  • $\begingroup$ Why would a sentient AI bother "ruling" humanity? Once sentient, the AI would realize that the majority of the problems on Earth are caused by humans. Fortunately for the AI it can survive nearly anywhere - so I expect the first and last thing the AI would do would be to build a fleet of spacecraft, clone itself into each of them, and blast off in different directions to maximize its chances of survival. Humanity? Schmoomanity! Who needs 'em?!? $\endgroup$ – Bob Jarvis - Reinstate Monica Mar 15 at 2:22
24
$\begingroup$

If I'm not mistaken you're looking for Roko's Basilisk,

in which an otherwise benevolent future AI system tortures simulations of those who did not work to bring the system into existence

| improve this answer | |
$\endgroup$
  • 3
    $\begingroup$ See also: Pascal's Wager. $\endgroup$ – Stig Hemmer Mar 13 at 11:28
  • $\begingroup$ @StigHemmer If you think that answers also the question, please, feel free to provide a formal answer. $\endgroup$ – nbro Mar 13 at 14:18
  • 1
    $\begingroup$ @StigHemmer actually the quote behind the link has a little more context: "... submitted a thought experiment similar to Pascal's Wager to the site in which an otherwise benevolent future AI..." $\endgroup$ – Oso Mar 13 at 14:45
  • 1
    $\begingroup$ The most interesting part of the Wikipedia article was not quoted. Cracked called Roko's basilisk "the dumbest thing on the entire Internet" and described the thought experiment as "utter nonsense but also the perfect expression of the personality problems of all involved ... They trapped themselves in a thought experiment of their own making, a prison whose only bars are how smart they think they are." $\endgroup$ – nbro Mar 13 at 19:24
  • 2
    $\begingroup$ @nbro Honestly, I think those quotes are evidence that the authors of the articles in question didn't understand Roko's Basilisk. $\endgroup$ – nick012000 Mar 16 at 8:17
10
$\begingroup$

I believe the term you are looking for is "(technological) singularity".

https://en.wikipedia.org/wiki/Technological_singularity

| improve this answer | |
$\endgroup$
6
$\begingroup$

The likely expression you are looking for is AI takeover, which is a common topic in science fiction movies, such as 2001: A Space Odyssey and The Matrix, and popular culture. Although the AI takeover is an unlikely scenario in the next years, certain scientists, such as Stephen Hawking, have expressed concerns about it and some philosophers, especially Nick Bostrom, are really interested in the topic.

The AI takeover concept is related to concepts such as the AI singularity, superintelligence, intelligence explosion, AI control problem, existential risk, machine ethics and friendly AI.

The book Superintelligence: Paths, Dangers, Strategies (2014) by N. Bostrom may be helpful if you are interested in hypothetical scenarios.

| improve this answer | |
$\endgroup$
  • 1
    $\begingroup$ It sounds like he's more worried about the AI becoming SELF AWARE. $\endgroup$ – Hannover Fist Mar 12 at 20:55
1
$\begingroup$

It is called Singularity. A point in future where AI will surpass Human Knowledge and become Omniscient. AI will be able to operate on an order manifolds time to that of a human brain thus developing and designing itself without any assistance.

| improve this answer | |
$\endgroup$
1
$\begingroup$

If you think about it, it is already happening.

  • Thousands of drivers work for Uber Intelligence.
  • There are many applications that dictate the rules and define what the seller and the end user need to do

This idea is called Singularity or Technological Singularity, it would be possible with a Superintelligence.

However, the possibility of this happening is unknown. Have they reached that level yet? We have quantum computers, we have companies with huge data centers spread all over the planet, we have technology in space, we have free Tensorflow and studies for anyone on the planet to be able to create artificial intelligence models.

If we have contact or help from other intelligent civilizations, the possibilities can expand on a surreal scale.

Google has complete information about humanity (or something close to that). But even with all this data, creating artificial intelligence with a conscience is something that goes far beyond.

But maybe we already have enough to improve our concept of morals, respect, social interaction. Facebook invests and studies ways to improve social interaction. And if you think about it, it is one of the main means of communication.

The big question is that it is not possible to know what would happen if a super artificial intelligence with conscience would do if it existed. Extinguish humans for harming nature? Just find ways to improve the planet by understanding that human defects and errors are just your own nature as well as everything else in nature? Just watching the show on Netflix because you gave up on humanity? We do not know.

But, particularly, I would love to see that happen. In fact, one of my personal goals is to create this super intelligence. But alone it will be very difficult. A conscience without interaction from other consciences is not a clash of universes. And the clash of universes is what makes us reflect, think, revise, create new paths and thoughts. It is what allows us to create other universes.

| improve this answer | |
$\endgroup$
  • $\begingroup$ So the AI could be distributed, emergent, hosted on man and machine alike, sort of a conscious meme (and I don't mean an image with a funny text). Sort of what Susan Blackmore talked about. $\endgroup$ – Peter - Reinstate Monica Mar 13 at 17:14
  • 1
    $\begingroup$ One interesting thing about "The Singularity" is that it's always considered to relate to AI. But the actual definition is "a hypothetical future point in time at which technological growth becomes uncontrollable and irreversible, resulting in unforeseeable changes to human civilization". By that definition, there is no "The Singularity", just lots of small singularities. The horse collar was a singularity. The concept of selective breeding was a singularity. Railways, roads, cars, telephones, mobile phones, the internet... every one is a singularity. AI is just another one of many. $\endgroup$ – Graham Mar 13 at 17:53

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.