Skip to main content
New
Stack Overflow Jobs powered by Indeed: A job site that puts thousands of tech jobs at your fingertips (U.S. only). Search jobs
37 votes
Accepted

Is the "Chinese room" an explanation of how ChatGPT works?

Yes, the Chinese Room argument by John Searle essentially demonstrates that at the very least it is hard to locate intelligence in a system based on its inputs and outputs. And the ChatGPT system is ...
Neil Slater's user avatar
  • 32.4k
31 votes
Accepted

How does ChatGPT retain the context of previous questions?

Based on an answer by OpenAI, it appears that the illusion of understanding context is created by the model's capacity to accept very long input sequences. The OpenAI FAQ states that approximately ...
milez's user avatar
  • 981
23 votes

What is the actual quality of machine translations?

Who claimed that machine translation is as good as a human translator? For me, as a professional translator who makes his living on translation for 35 years now, MT means that my daily production of ...
Herbert's user avatar
  • 231
21 votes

Is the "Chinese room" an explanation of how ChatGPT works?

Yes it is a good analogy, as explained nicely by Neil. Regarding your second question: how far is AI from models that can actually understand (for some definition of "understand") textual ...
Rexcirus's user avatar
  • 1,174
14 votes

Is the "Chinese room" an explanation of how ChatGPT works?

Searle's Chinese room is not intended as a functional description of any real-world machine. Searle was a philosopher who created the Chinese room as a thought experiment to show what he considered an ...
ACuriousMind's user avatar
11 votes

How does ChatGPT know math?

Adding on to txopen's answer, it is interesting to note that for larger numbers with similar digits ChatGPT is unable to make any useful distinctions. For instance: Me: Which number is bigger: 1234.12 ...
Milo Moses's user avatar
10 votes

How does ChatGPT respond to novel prompts and commands?

Text continuation has the same reasons to work in any context, be it the middle of a sentence, after a question or after instructions. Following your example, the same word sequence could be a good ...
Jaume Oliver Lafont's user avatar
8 votes

Does chatGPT learn or remember from (public) user input? Will it 'fess up to it? I could not get it to reveal

ChatGPT does not answer to just your last question, but to the whole dialog. It tries to continue the dialog in a way that has the same structure as the gigabytes of other texts it has studied. GPT-3 ...
Florian F's user avatar
  • 181
7 votes

What is the actual quality of machine translations?

Google's translations can be useful, especially if you know that the translations are not perfect and if you just want to have an initial idea of the meaning of the text (whose Google's translations ...
nbro's user avatar
  • 40.8k
6 votes

What is the actual quality of machine translations?

You have asked quite a lot of questions, some of which cannot be answered definitively . To give an insight of the quality (and its history) of machine translations I like to refer to Christopher ...
RikH's user avatar
  • 161
6 votes
Accepted

Why does Google Translate produce two different translations for the same Chinese text?

It's not quite clear what you are asking. So I'll answer in separate parts. Why is the translation different from the official title? It could be simply because machine translation is not perfect, ...
k.c. sayz 'k.c sayz''s user avatar
6 votes

How does ChatGPT know math?

I think that the dataset is so large and the model so well trained that it understood the probabilistic correlation of length in a token of numbers before a dot separation, and then the influence of ...
txopen's user avatar
  • 61
6 votes

Is the "Chinese room" an explanation of how ChatGPT works?

The chinese room argument is useless because it can be applied to the brain as well. Replace the slit with sensory input, the handbook with the wiring of the brain and the activity of the agent inside ...
minimal's user avatar
  • 61
5 votes
Accepted

What research has been done in the domain of "identifying sarcasm in text"?

The following survey article by researchers from IIT Bombay summarizes recent advances in sarcasm detection: Arxiv link. In reference to your question, I do not think it is considered either ...
Harsh's user avatar
  • 1,315
5 votes
Accepted

How could facts be distinguished from opinions?

I will be starting my PhD in natural language processing in a few days and this is very similar to my proposed topic. It's an open problem that ties NLP and AI into philosophy of science and ...
primussucks's user avatar
5 votes

How is the F1 score calculated in a question-answering system?

In QA, it's computed over the individual words in the prediction against those in the True Answer. The number of shared words between the prediction and the truth is the basis of the F1 score: ...
Chin Hui Chew's user avatar
5 votes

How does ChatGPT retain the context of previous questions?

Based on nothing but my own experience trying to build a similar chatbot using text-davinci-003, I think they are using the model itself to summarize the conversation, then feeding that summary back ...
RLC's user avatar
  • 214
4 votes

What is the actual quality of machine translations?

It really depends on the language pair and the topic of the content. Translating to/from English to any other language usually is the best supported. Translating to and from popular languages works ...
Aaron Butacov's user avatar
3 votes

How can I make ELIZA more realistic?

One 'easy' way would be to have some sort of conversational memory, where you track what the user has said already. I don't know how complex your patterns are, but if you could recognise names and ...
Oliver Mason's user avatar
  • 5,387
3 votes

What are the current big challenges in natural language processing and understanding?

According to a nice article by Sebastian Ruder https://ruder.io/4-biggest-open-problems-in-nlp/ based on answers from top NLP researchers https://docs.google.com/document/d/18NoNdArdzDLJFQGBMVMsQ-...
cookiemonster's user avatar
3 votes

Can a computer identify the philosophical concept on which a given story is based?

No. This is currently out of the scope for any language processing system. It requires a general understanding of abstract concepts which is not possible for machines at present. In order to ...
Oliver Mason's user avatar
  • 5,387
3 votes
Accepted

How to recognise metaphors in texts using NLP/NLU?

This is still a research topic in linguistics. A quick google search brings up a couple of papers that might be useful: Identifying Metaphor Hierarchies in a Corpus Analysis of Finance Articles ...
Oliver Mason's user avatar
  • 5,387
3 votes
Accepted

Can we make a chatbot that really "understands" the questions?

This question has been studied academically for decades, and is really an extension of the work on Philosophy of Mind that was done in the two or three centuries before that. A good resource is Mind ...
John Doucette's user avatar
3 votes
Accepted

How can a system like Jarvis understand the commands and take actions?

Jarvis was built using the suite of tools that facebook developers are constantly updating. The answer to this question is that there's no simple answer; it has a lot of moving parts. Take for example ...
v4gil's user avatar
  • 146
3 votes

Are there any meaningful books entirely written by an artificial intelligence?

James Ryan has done a lot of 'archaeological' work on this; you can find references to his work on his website. Story generation has been a dream for a long time (in computing terms), and various ...
Oliver Mason's user avatar
  • 5,387
3 votes

What puts the "chat" in a system like ChatGPT?

TLDR: It is taught to do that during training The secret sauce here is not in the architecture but in the fine-tuning part of the training process. The details of which have not been made public yet. ...
Robin van Hoorn's user avatar
2 votes

What are the most recent and influential breakthroughs in NLP?

I suggest you take a look at the syllabus of http://cs224d.stanford.edu/syllabus.html and see what was invented in the last ~20 years. They focus on deep learning methods, and they include there ...
Konstantin Solomatov's user avatar
2 votes

What research has been done in the domain of "identifying sarcasm in text"?

There has been a recent work in the same domain where neural networks(CNNs to be accurate) are used for the same purpose. Some info. about the research is: To learn that context, the paper ...
Dawny33's user avatar
  • 1,371
2 votes

Why does Google Translate produce two different translations for the same Chinese text?

As you know google translation works base on statistical methods. In statistical translation, many parameters can be related to the final result. One of these parameters is co-occurrence of words in a ...
OmG's user avatar
  • 1,816
2 votes

Can we make a chatbot that really "understands" the questions?

Defining what it means to understand something is a complex philosophical question, with answers that can split the AI community into different camps. Clearly an algorithm that associates the ASCII ...
Neil Slater's user avatar
  • 32.4k

Only top scored, non community-wiki answers of a minimum length are eligible