23 votes

What is the actual quality of machine translations?

Who claimed that machine translation is as good as a human translator? For me, as a professional translator who makes his living on translation for 35 years now, MT means that my daily production of ...
  • 231
7 votes

What is the actual quality of machine translations?

Google's translations can be useful, especially if you know that the translations are not perfect and if you just want to have an initial idea of the meaning of the text (whose Google's translations ...
  • 36.3k
7 votes
Accepted

How does ChatGPT retain the context of previous questions?

Based on an answer by OpenAI, it appears that the illusion of understanding context is created by the model's capacity to accept very long input sequences. The OpenAI FAQ states that approximately ...
  • 291
7 votes

How does ChatGPT respond to novel prompts and commands?

Text continuation has the same reasons to work in any context, be it the middle of a sentence, after a question or after instructions. Following your example, the same word sequence could be a good ...
6 votes

What is the actual quality of machine translations?

You have asked quite a lot of questions, some of which cannot be answered definitively . To give an insight of the quality (and its history) of machine translations I like to refer to Christopher ...
  • 161
5 votes
Accepted

Why does Google Translate produce two different translations for the same Chinese text?

It's not quite clear what you are asking. So I'll answer in separate parts. Why is the translation different from the official title? It could be simply because machine translation is not perfect, ...
5 votes
Accepted

What research has been done in the domain of "identifying sarcasm in text"?

The following survey article by researchers from IIT Bombay summarizes recent advances in sarcasm detection: Arxiv link. In reference to your question, I do not think it is considered either ...
  • 1,134
5 votes
Accepted

How could facts be distinguished from opinions?

I will be starting my PhD in natural language processing in a few days and this is very similar to my proposed topic. It's an open problem that ties NLP and AI into philosophy of science and ...
5 votes

How does ChatGPT know math?

I think that the dataset is so large and the model so well trained that it understood the probabilistic correlation of length in a token of numbers before a dot separation, and then the influence of ...
  • 51
5 votes

Does chatGPT learn or remember from (public) user input? Will it 'fess up to it? I could not get it to reveal

ChatGPT does not answer to just your last question, but to the whole dialog. It tries to continue the dialog in a way that has the same structure as the gigabytes of other texts it has studied. GPT-3 ...
  • 151
4 votes

What is the actual quality of machine translations?

It really depends on the language pair and the topic of the content. Translating to/from English to any other language usually is the best supported. Translating to and from popular languages works ...
4 votes

How is the F1 score calculated in a question-answering system?

In QA, it's computed over the individual words in the prediction against those in the True Answer. The number of shared words between the prediction and the truth is the basis of the F1 score: ...
4 votes

Can a computer identify the philosophical concept on which a given story is based?

No. This is currently out of the scope for any language processing system. It requires a general understanding of abstract concepts which is not possible for machines at present. In order to ...
  • 5,207
3 votes

How can I make ELIZA more realistic?

One 'easy' way would be to have some sort of conversational memory, where you track what the user has said already. I don't know how complex your patterns are, but if you could recognise names and ...
  • 5,207
3 votes

What are the current big challenges in natural language processing and understanding?

According to a nice article by Sebastian Ruder https://ruder.io/4-biggest-open-problems-in-nlp/ based on answers from top NLP researchers https://docs.google.com/document/d/18NoNdArdzDLJFQGBMVMsQ-...
3 votes
Accepted

How to recognise metaphors in texts using NLP/NLU?

This is still a research topic in linguistics. A quick google search brings up a couple of papers that might be useful: Identifying Metaphor Hierarchies in a Corpus Analysis of Finance Articles ...
  • 5,207
3 votes
Accepted

Can we make a chatbot that really "understands" the questions?

This question has been studied academically for decades, and is really an extension of the work on Philosophy of Mind that was done in the two or three centuries before that. A good resource is Mind ...
3 votes
Accepted

How can a system like Jarvis understand the commands and take actions?

Jarvis was built using the suite of tools that facebook developers are constantly updating. The answer to this question is that there's no simple answer; it has a lot of moving parts. Take for example ...
  • 146
3 votes

Are there any meaningful books entirely written by an artificial intelligence?

James Ryan has done a lot of 'archaeological' work on this; you can find references to his work on his website. Story generation has been a dream for a long time (in computing terms), and various ...
  • 5,207
3 votes

How does ChatGPT know math?

Adding on to txopen's answer, it is interesting to note that for larger numbers with similar digits ChatGPT is unable to make any useful distinctions. For instance: Me: Which number is bigger: 1234.12 ...
2 votes

What are the most recent and influential breakthroughs in NLP?

I suggest you take a look at the syllabus of http://cs224d.stanford.edu/syllabus.html and see what was invented in the last ~20 years. They focus on deep learning methods, and they include there ...
2 votes

What research has been done in the domain of "identifying sarcasm in text"?

There has been a recent work in the same domain where neural networks(CNNs to be accurate) are used for the same purpose. Some info. about the research is: To learn that context, the paper ...
  • 1,371
2 votes

Why does Google Translate produce two different translations for the same Chinese text?

As you know google translation works base on statistical methods. In statistical translation, many parameters can be related to the final result. One of these parameters is co-occurrence of words in a ...
  • 1,703
2 votes

What is the actual quality of machine translations?

Apologies for not writing in English. Please find the adapted translation here: To give interested people an idea of the quality of MT (DeepL) please see this example from a text I was working on ...
  • 21
2 votes

What is the actual quality of machine translations?

Am I wrong and Google's translations are nevertheless readable, helpful and useful for a majority of users? Yes, they are somewhat helpful and allow you to translate faster. Or does Google have ...
2 votes

Can we make a chatbot that really "understands" the questions?

Defining what it means to understand something is a complex philosophical question, with answers that can split the AI community into different camps. Clearly an algorithm that associates the ASCII ...
  • 25.4k
2 votes

Is there a machine learning system that is able to understand mathematical problems given in a textual description?

There was a lot of work on this topic at UT Austin, which has now migrated to the Alan Institute. There is no off-the-shelf software that will answer your question (if there was, DARPA would stop ...
1 vote

How to predict the "word" based on the meaning in a document?

While your question has some ambiguities, I try to answer. From my understanding you want your model to predict the “topic” of a sentence or a description. It’s just a classification problem with a ...
  • 303
1 vote
Accepted

When to use NLP, NLG and NLU in conversation agents?

They're all important. NLP is an umbrella term that includes the other two; NLG is only concerned with generating language, ie transforming some internal data structure into human language. NLU is ...
  • 5,207
1 vote
Accepted

How would you build an AI to output the primary concept of a paragraph?

Identifying the primary concepts of a paragraph required understanding of the meaning of the text. In natural language processing, we are still a long way off even recognising and representing the ...
  • 5,207

Only top scored, non community-wiki answers of a minimum length are eligible