Questions tagged [agi]
For questions about Artificial General Intelligence (AGI), a hypothetical machine characteristic permitting it to learn any arbitrary intellectual ability up to the limits of the available computing resources.
183
questions
1
vote
0
answers
47
views
Rationale behind risk of malevolent superintelligence
I'm hoping some of you can shed light on a few hypothetical questions about AGI. My understanding is that AGI refers to an agent that can reason, strategize, solve problems, make judgments under ...
- 135
5
votes
2
answers
214
views
Will the AI be able to formulate scientific principles or theories missed by humans in the future?
I do not know at all how AI works.
After checking out the first open AI system available to the public, ChatGPT, I am curious whether systems like this could contribute to scientific theory in the ...
user69389
3
votes
1
answer
61
views
What is meant by "Deep Learning models are not understood"?
It is a sentence that I hear a lot and I guess I don't get what it means.
It seems that the weight optimization procedure is very well understood and there is, to some extent, theoretical/empirical ...
- 33
31
votes
6
answers
12k
views
Is the "Chinese room" an explanation of how ChatGPT works?
Sorry if this question makes no sense. I'm a software developer but know very little about AI.
Quite a while ago, I read about the Chinese room, and the person inside who has had a lot of training/...
- 421
1
vote
1
answer
54
views
Solve the AI alignment problem using (meta-level) AI itself?
If the AI alignment problem is one of the most pressing issues of our time, could AI itself augment our (i.e., human) quest to solve the alignment problem? Or would AI itself actually be counter-...
- 111
0
votes
1
answer
197
views
How does chatGPT know it's an AI?
I've tried several prompts to understand how does it "know" that it's an AI, but it's answers are inconclusive for me. It says that it was hard-coded to recognize keywords in this regard, ...
0
votes
1
answer
50
views
Why expect AGI from non-Turing complete AI paradigms?
As far as I can tell, all the successful AI paradigms are not Turing complete.
On the other hand, the human mind is Turing complete.
Why would we expect any of these AI paradigms to give us human ...
- 337
0
votes
1
answer
23
views
Is this a better formulation of the Turing test?
Would the Turing test be better formulated by assessing whether the creator (as opposed to a third party) was able to tell the difference between their program and a human?
A magician, through the use ...
-1
votes
1
answer
45
views
Why does some AI professionals think deep learning is "intelligent"?
Human is intelligent, this is the ultimate definition (although not rigorous) of intelligence.
Ordinary programs are not considered "intelligent", even they can do so many smart things with ...
- 199
2
votes
0
answers
96
views
What are the main arguments predicting a Soft Takeoff vs Hard Takeoff scenario and viceversa?
Here I am referring to the term AI Takeoff as described here on LessWrong, with annexed "Soft" and "Hard" takeoff definitions.
I find that page to be biased slightly more towards ...
- 271
1
vote
1
answer
223
views
Why are AI Safety discussions almost always from the perspective of reinforcement learning?
I have been reading some articles on AI safety and they almost always speak of AI Safety from the reinforcement learning (RL) perspective, i.e. where we have some artificially intelligent agent acting ...
- 271
0
votes
1
answer
101
views
What is the need for _agency_ in AI? [closed]
Why seek to develop artificially intelligent agents? Are there certain advantages and/or needs provided by such supposed intelligent agents that are preferred to simply using intelligent tools that ...
- 271
2
votes
1
answer
124
views
Can an AI have awareness?
I was thinking about the following:
According to Sir Roger Penrose "No computer has any awareness of what it does.".
Now some context to his statement:
Penrose’s argument in summary in his ...
- 121
1
vote
1
answer
73
views
What consequence would a polynomial time algorithm for SAT have on AGI?
$P$ vs $NP$ is a famous problem. We generally believe $P\neq NP$. However suppose there is a polynomial time algorithm of order say $O((n+m)^2)$ or $O((n+m)^3)$ (a low degree polynomial complexity ...
- 131
0
votes
1
answer
37
views
Theoretically, how can the trait "humbleness" be incorporated into AI design, specifically Artificial General Intelligence?
On Google Scholar ("humble" and "AI") yields (About 175,000 results), while ("Humble AI") yields about 34 results.
It seems that the trait of "humbleness" and ...
- 545
1
vote
1
answer
101
views
What can we learn from AlphaZero in the development towards AGI?
According to DeepMind,
AlphaZero's creative insights coupled with the encouraging results we see in other projects such as AlphaFold, give us confidence in our mission to create general purpose ...
- 133
0
votes
0
answers
60
views
Can brain simulation be done using Tensor Processing Units?
A potential way to solving AI is via whole brain simulation. Currently we have the algorithm to model a human brain (albeit far from perfectly): https://thenextweb.com/news/theres-an-algorithm-to-...
4
votes
2
answers
320
views
What algorithms are used in Artificial General Intelligence research?
I've read on wiki that already in 2017 there were over 40 institutions researching AGI, and I wonder what type of algorithms are being studied and developed in this field.
For example, for comparison ...
- 1,240
0
votes
2
answers
146
views
The only convergent instrumental goal for self modifying AI
Conjecture: regardless of the initial reward function, one of the winning strategies would be to change the reward function to a simpler one (e.g. "do nothing"), thus getting a full reward ...
- 221
1
vote
0
answers
88
views
Which topics about/in OpenCog could be researched in a Ph.D. thesis
In this interview with Lex Fridman and Ben Goertzel, at 2:23:48, Lex asks about possibilities for young people in the domain of AGI research. Ben Goertzel then answers that there are various ...
- 91
1
vote
2
answers
146
views
Can an animal-level artificial general intelligence kickstart the Singularity? [closed]
Most people seem to assume that we need a human-level AI as a starting point for the Singularity.
Let's say someone invents a general intelligence that is not quite on the scale of a human brain, but ...
- 69
0
votes
0
answers
58
views
Why the collection of background/negative image dataset is not taught in object detection tutorials and books?
While I was doing an object detection project, I have encountered the problem of getting FALSE POSITIVES and FALSE NEGATIVES. After days of research on StackOverflow, I figured out that I need to ...
1
vote
0
answers
97
views
Might AGI need to be flawed?
An example is the halting problem, which states computing cannot be solved by exhaustion, but which humans avoid trivially by becoming exhausted.
Humans typically give up what seems like a lost cause ...
- 6,177
5
votes
2
answers
152
views
Why can't cognitive architectures achieve general intelligence?
Newbie here.
I recently read about cognitive architectures (see: https://en.wikipedia.org/wiki/Cognitive_architecture). They are supposed to be modeled after the human mind and represent a promising ...
- 69
1
vote
2
answers
148
views
Is there any specific SW framework, libraries or algorithms (supported by any theory) designed for implementing a practical AGI system? [closed]
Any (AGI)-KERAS like libraries? Any deep-learning framework to develop AGI applications?
Existing frameworks/algorithms used in NN, NLP, ML, etc are not enough in my opinion. In my opinion any ...
- 97
5
votes
3
answers
245
views
How widely accepted is the definition of intelligence by Marcus Hutter & Shane Legg?
I came across several papers by M. Hutter & S. Legg.
Especially this one:
Universal Intelligence: A Definition of Machine Intelligence, Shane Legg, Marcus Hutter
Given that it was published back ...
- 255
5
votes
1
answer
208
views
Are there any approaches to AGI that will definitely not work?
Is there empirical evidence that some approaches to achieving AGI will definitely not work? For the purposes of the question the system should at least be able to learn and solve novel problems.
Some ...
- 153
4
votes
1
answer
179
views
Current research on Gödel machines
Is there any current research on Gödel machines? It seems that the last article by Jürgen Schmidhuber on this topic was published in 2012: http://people.idsia.ch/~juergen/goedelmachine.html
4
votes
2
answers
330
views
How much is currently invested in artificial general intelligence research and development?
How much is currently invested in artificial general intelligence research and development worldwide?
Feel free to add company or VC names, but this is not the point. The point is to get an idea of ...
- 189
4
votes
2
answers
176
views
What is the current artificial general intelligence technology valuation?
That is, if AGI were an existing technology, how much would it be valued to?
Obviously it would depend on its efficiency, if it requires more than all the existing hardware to run it, it would be ...
- 189
2
votes
1
answer
175
views
Is GPT-3 an early example of strong AI in a narrow setting?
In GPT-2, the large achievement was being able to generate coherent text over a long-form while maintaining context. This was very impressive but for GPT-2 to do new language tasks, it had to be ...
- 500
1
vote
0
answers
100
views
How differentiable programming and programming language supporting it will potentially help the development towards AGI?
After the state of the art Deep Learning techniques/algorithms being implemented in low-level languages like Objective-C, C++, etc to high-level languages like Python, JS, etc. and with the help of ...
- 384
2
votes
1
answer
185
views
Use of virtual worlds (e.g. Second Life) for training Artificial General Intelligence agents?
There is emerging effort for Third Wave Artificial Intelligence (Artificial General Intelligence) (http://hlc.doc.ic.ac.uk/3AI_HLC_2019.html and https://www.darpa.mil/work-with-us/ai-next-campaign) ...
- 803
4
votes
2
answers
169
views
How can we prevent AGI from doing drugs?
I recently read some introductions to AI alignment, AIXI and decision theory things.
As far as I understood, one of the main problems in AI alignment is how to define a utility function well, not ...
- 143
1
vote
1
answer
93
views
Is increasing software complexity the most likely bottleneck to the AI singularity?
From Wikipedia:
According to the most popular version of the singularity hypothesis, called intelligence explosion, an upgradable intelligent agent will eventually enter a "runaway reaction"...
- 1,054
1
vote
2
answers
543
views
What is the Turing test?
I'm looking for intuition in simple words but also some simple insights (I don't know if the latter is possible). Can anybody shed some light on the Turing test?
- 1,223
14
votes
2
answers
1k
views
How does one prove comprehension in machines?
Say we have a machine and we give it a task to do (vision task, language task, game, etc.), how can one prove that a machine actually know's what's going on/happening in that specific task?
To narrow ...
- 500
1
vote
1
answer
128
views
Are there any conferences dedicated to artificial general intelligence?
Similarly to What are the scientific journals dedicated to artificial general intelligence?, are there any conferences dedicated to artificial general intelligence?
- 37.1k
0
votes
1
answer
173
views
Are there other mathematical frameworks of artificial general intelligence apart from AIXI?
AIXI is a mathematical framework for artificial general intelligence developed by Marcus Hutter since the year 2000. It's based on many concepts, such as reinforcement learning, Bayesian statistics, ...
- 37.1k
3
votes
1
answer
255
views
Does Gödel's second incompleteness theorem put a limitation on artificial intelligence systems?
According to Brian Cantwell Smith
no calculation without representation
Therefore, computers depend on models. So, we can say that AI is limited internally by the model and externally by the ...
- 59
1
vote
0
answers
96
views
What does a self-improving artificial general intelligence with finite resources and infinite time do?
What would happen when an artificial general intelligence can improve itself over a long time, with limited resources?
The assumption is that it has a large but finite amount of computing power, and ...
- 272
3
votes
2
answers
198
views
What are the scientific journals dedicated to artificial general intelligence?
Apart from Journal of Artificial General Intelligence (a peer-reviewed open-access academic journal, owned by the Artificial General Intelligence Society (AGIS)), are there any other journals (or ...
- 37.1k
2
votes
2
answers
514
views
Who first coined the term "artificial general intelligence"?
Similarly to the question Who first coined the term Artificial Intelligence?, who first coined the term "artificial general intelligence"?
- 37.1k
2
votes
1
answer
577
views
What are some online courses on artificial general intelligence?
Although no artificial general intelligence (AGI) has yet been created, probably, there are already some courses on the topic. So, what are some online (preferably free) courses on AGI?
- 37.1k
0
votes
2
answers
140
views
Does this prove AI Safety is undecidable?
Does this prove AI Safety is undecidable?
Proof:
Output meaning output to computer program.
[A1] Assume we have a program that decides which outputs are “safe”.
[A2] Assume we have an example of ...
- 169
3
votes
1
answer
296
views
Does Rice's theorem prove safe AI is undecidable?
According to Wikipedia
In computability theory, Rice's theorem states that all non-trivial,
semantic properties of programs are undecidable. A semantic property
is one about the program's ...
- 169
2
votes
1
answer
167
views
What assumptions are made when positing the emergence of superintelligence?
Many experts seem to think that artificial general intelligence, or AGI, (on the level of humans) is possible and likely to emerge in the near-ish future. Some make the further step to say that ...
- 23
2
votes
1
answer
58
views
Would a new human-like general artificial intelligence be more similar, in terms of eduction, to a toddler or an adult human?
The naive concept of a general AI, or strong AI, or artificial general intelligence, is some kind of software that can answer questions like
What is the volume of a cube that is 1 m wide?
or ...
- 272
15
votes
5
answers
3k
views
What is the idea called involving an AI that will eventually rule humanity?
It's an idea I heard a while back but couldn't remember the name of. It involves the existence and development of an AI that will eventually rule the world and that if you don't fund or progress the ...
- 153
2
votes
0
answers
158
views
Is an oracle that answers only with a "yes" or "no" dangerous?
I was thinking about the risks of Oracle AI and it doesn't seem as safe to me as Bostrom et al. suggest. From my point of view, even an AGI that only answers questions could have a catastrophic impact....
- 131