34
votes
Accepted
Is the "Chinese room" an explanation of how ChatGPT works?
Yes, the Chinese Room argument by John Searle essentially demonstrates that at the very least it is hard to locate intelligence in a system based on its inputs and outputs. And the ChatGPT system is ...
- 27k
20
votes
Is the "Chinese room" an explanation of how ChatGPT works?
Yes it is a good analogy, as explained nicely by Neil.
Regarding your second question:
how far is AI from models that can actually understand (for some
definition of "understand") textual ...
- 1,106
13
votes
Is the "Chinese room" an explanation of how ChatGPT works?
Searle's Chinese room is not intended as a functional description of any real-world machine. Searle was a philosopher who created the Chinese room as a thought experiment to show what he considered an ...
- 231
10
votes
Accepted
Will the AI be able to formulate scientific principles or theories missed by humans in the future?
This already happened:
What directly comes to my mind is AlphaTensor that developed a novel method for matrix multiplication. Matrix multiplication is a computational expensive and often used ...
- 531
6
votes
How does chatGPT know it's an AI?
Unlike GPT-2/3 (and other language models around, such as OPT, PaLM, and BLOOM), it is trained not only on the texts downloaded from the Internet. After pre-training on purely textual data (OpenAI ...
- 321
6
votes
Is the "Chinese room" an explanation of how ChatGPT works?
The chinese room argument is useless because it can be applied to the brain as well. Replace the slit with sensory input, the handbook with the wiring of the brain and the activity of the agent inside ...
- 61
5
votes
What are the reasons to belief AGI will not be dangerous?
The correct arguments against it are not so much against pessimism as against certainty. It is simply difficult to say right now, because we know very little about the concrete technical problems we ...
- 149
3
votes
Solve the AI alignment problem using (meta-level) AI itself?
Yes, this is one the most popular approaches today. For instance a narrow AI model is built to capture the preference of the user and then this model is used to dispense reward to a reinforcement ...
- 1,106
3
votes
Accepted
What is meant by "Deep Learning models are not understood"?
There are broadly two phenomena that are often referred to as not understanding deep learning:
It is not well understood how the network arrives at any particular solution. Trying to analyze the ...
- 2,155
3
votes
Accepted
What can we learn from AlphaZero in the development towards AGI?
Some learnings from AlphaZero:
Self-play, and more generally sandbox training, is effective. This indicates that given the right enviroment and enough computational power we can build highly ...
- 1,106
3
votes
Accepted
Why are AI Safety discussions almost always from the perspective of reinforcement learning?
I think what you are really asking is why don't we talk about alignment from the perspective of general deep learning?
In fact, we do talk about alignment for general AI system that's being used in ...
- 98
2
votes
Why does some AI professionals think deep learning is "intelligent"?
Partly due to the fact that deep learning can solve tasks considered to be challenging, and it does so by learning. This is the main differentiator w.r.t. old fashioned hardcoded algorithms. Indeed ...
- 1,106
2
votes
Accepted
Does this prove AI Safety is undecidable?
You are essentially correct, although there may be some minor holes in the structure of your argument specifically. But if we're speaking informally, yes, you are correct. This is a consequence of ...
- 136
2
votes
Accepted
Why expect AGI from non-Turing complete AI paradigms?
On the other hand, the human mind is Turing complete.
This is a common confusion about what "Turing completeness" entails. The human brain is not Turing complete, as it is not infinite and ...
- 46
2
votes
Is the "Chinese room" an explanation of how ChatGPT works?
As many have stated, the Chinese room analogy is intended to show that any hardware + software instance that relies on rules alone (logical operators on input symbols) cannot be said to have ...
2
votes
Will the AI be able to formulate scientific principles or theories missed by humans in the future?
Yes, from first principles.
Discovering new scientific theories is a mixture of following a set of mathematical logic principles and using creativity to come up with something new and useful.
...
- 1,106
1
vote
What are the reasons to belief AGI will not be dangerous?
I think that a large hunk of the worry about AGI isn't because of any inherent properties or unknown unknowns of AGI per se; rather, the worry is based on inherent properties and known knowns of ...
- 161
1
vote
Is the "Chinese room" an explanation of how ChatGPT works?
I suggest it makes all the difference in the world whether 'the knowledge' was acquired by parsing many examples to get 'a feeling for what's right' (AI/learning), or by detailed instructions (...
- 111
1
vote
Is this a better formulation of the Turing test?
For the purpose of having AI on par with humans and releasing it to the market is not that relevant that the creator, a single person, can still not be fooled.
Moreover this would create a conflict of ...
- 1,106
1
vote
What is the need for _agency_ in AI?
Interesting question(s). I understand an 'agent' as an entity that perceives its environment, performs appropriate actions, and can to a certain degree adapt its behavior. If such an agent is also ...
- 383
1
vote
Why can't cognitive architectures achieve general intelligence?
This is a philosophical question that does not have a one-off answer.
If I may suggest a quick thought:
Our brains are trained on millions of tasks when we grow up (recognising so many objects, ...
- 216
1
vote
Use of virtual worlds (e.g. Second Life) for training Artificial General Intelligence agents?
Yes, there are actually quite a few examples of this:
https://www.deepmind.com/publications/open-ended-learning-leads-to-generally-capable-agents
https://ieeexplore.ieee.org/abstract/document/9089532/
...
- 1,235
Only top scored, non community-wiki answers of a minimum length are eligible