Questions tagged [natural-language-understanding]

For questions related to natural language understanding (NLU), which is a subtopic of natural language processing (NLP) that deals with machine reading comprehension. Natural-language understanding is considered a hard problem.

Filter by
Sorted by
Tagged with
0 votes
1 answer
23 views

What is the role of self loop in Hidden Markov Models(HMM)?

What actually does the self-loop (within the single hidden state ) in the Hidden Markov model helpful for? I learn that one of the use cases concerning Natural language Understanding is that it helps ...
0 votes
3 answers
76 views

How do I use A.I. to analyse & score news articles?

I'm working on a project that would benefit from using A.I. or machine learning to analyse news feeds from a variety of websites and grade each article between 0 and 10. We would manually grade ...
1 vote
2 answers
214 views

How to extract parameters from a text using AI/NLP

lets say I have three texts: "make a heading that says hello word" "make a heading of hello world" "create heading consist of hello world" How can I fetch those groups ...
1 vote
0 answers
23 views

How do I preload a conversational AI assistant like GPT-3 with complex relational data to draw on?

I'm exploring options to build a virtual assistant type of product. Creating good dialog is mostly solved with GPT-3 or even DialoGPT. My main question is how do I add larger amounts of relational ...
3 votes
1 answer
52 views

Is there a complement to GPT/2/3 that can be trained using supervised learning methods?

This is a bit of a soft question, not sure if it's on topic, please let me know how I can improve it if it doesn't meet the criteria for the site. GPT models are unsupervised in nature and are (from ...
2 votes
1 answer
73 views

How might AI analyze abusive discussion using natural language grammar?

Opening thoughts This does not only apply to SE comments, but the idea in general. This is not a Question for Linguistics.SE; those Questions might come later, after AI analysis. Example Linguistics ...
2 votes
1 answer
78 views

How to predict the "word" based on the meaning in a document?

What I mean to say is For example, if I give the meaning of Apple from the dictionary as input to the program, it should give output as Apple. Or I say My day to day job involves monitoring and ...
7 votes
2 answers
2k views

How is the F1 score calculated in a question-answering system?

I have an NLP model for answer-extraction. So, basically, I have a paragraph and a question as input, and my model extracts the span of the paragraph that corresponds to the answer to the question. I ...
18 votes
2 answers
351 views

What research has been done in the domain of "identifying sarcasm in text"?

Identifying sarcasm is considered one of the most difficult open-ended problems in the domain of ML and NLP/NLU. So, was there any considerable research done on that front? If yes, then what is the ...
2 votes
1 answer
67 views

How would you build an AI to output the primary concept of a paragraph?

My thinking is you input a paragraph, or sentence, and the program can boil it down to the primary concept(s). Example: Input: Sure, it would be nice if morality was simply a navigation toward ...
4 votes
1 answer
166 views

Can a computer identify the philosophical concept on which a given story is based?

Say you have to enter a story to a computer. Now, the computer has to identify the philosophical concept on which the story is based, say: Was it a "self-fulfilling prophecy"? Was it an ...
0 votes
0 answers
14 views

How might I extend named entity recognition to recognise sentence or phrases as belonging to certain classes, such as commentary, opinion etc?

Suppose I have a news report such as THE ARCE BATTALION COMMAND HAS REPORTED THAT ABOUT 50 PEASANTS OF VARIOUS AGES HAVE BEEN KIDNAPPED BY TERRORISTS OF THE FARABUNDO MARTI NATIONAL LIBERATION FRONT [...
1 vote
2 answers
37 views

Among N documents, how to summarize the most unique content in each document?

I now have $N$ documents, which share common content and they have special unique content. Say I have $3$ legal documents related to the same person. Document $A$ is about land law, document $B$ is ...
4 votes
3 answers
165 views

Can we make a chatbot that really "understands" the questions?

Can we make a chatbot that really "understands" (rather than just replies to) questions based on the database/options of replies that it has? I mean, can it come up with correct/non-stupid ...
1 vote
0 answers
29 views

Is there something like person-specific sentiment analysis?

Sentiment analysis, as we know, measures "Cake sucks" as say -0.4, and "Cake is great" as 0.7. What I'm looking for is something a bit different like so: Given input text data ...
1 vote
1 answer
789 views

What is MNLI-(m/mm)?

I came across the term MNLI-(m/mm) in Table 1 of the paper BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. I know what MNLI stands for, i.e. Multi-Genre Natural ...
7 votes
1 answer
2k views

How to recognise metaphors in texts using NLP/NLU?

What are the current NLP/NLU techniques that can extract metaphors from texts? For example His words cut deeper than a knife. Or a simpler form like: Life is a journey that must be travelled no ...
2 votes
1 answer
309 views

How to measure the similarity the pronunciation of two words?

I would like to know how I could measure the pronunciation of two words. These two words are quite similar and differ only in one vowel. I know there is, e.g., the Hamming distance or the Levenshtein ...
1 vote
0 answers
110 views

What is the best way to generate German paraphrases?

What is the best method to generate German paraphrases? The state-of-the-art are seq2seq transformer models, like T5, but they only work for English sentences. I found the multilingual MT5 model, but ...
1 vote
0 answers
47 views

Text matching: fuzzy names matching with learning

I'm new to AI/ML and I want to research and learn about techniques that could help me to solve this complex task. Any hint would be appreciated. Let me explain it with an example: Let's look at two ...
1 vote
0 answers
14 views

Can unsupervised models learn something from cat vocalizations?

I love cats, and over the years have noticed that they have recurrent patterns of vocalizations. For example, upon seeing a bird, a cat may start chittering, but the same cat would never chitter at ...
-1 votes
1 answer
28 views

Extracting values from text based on keywords

I am trying to read a PDF file and put it in Python string and trying to fetch information based on keywords. The text here is completely irregular. Example of text Blockquote Ram has taken an ...
1 vote
0 answers
162 views

How homographs is an NLP task can be treated?

A homograph - is a word that shares the same written form as another word but has a different meaning. They can be even different parts of speech. For example: close(verb) - close(adverb) lead(verb)...
3 votes
1 answer
96 views

How would one disambiguate between two meanings of the same word in a sentence?

The boy lifted the bat and hit the ball. In the above sentence, the noun "bat" means the wooden stick. It does not mean bat, the flying mammal, which is also a noun. Using NLP libraries to ...
1 vote
1 answer
202 views

What dataset might Elon Musk's Dall-E have used?

Dall-E, it can generate many imaginative images from the description, even some peculiar images, how did they actually create this kind of dataset to train this AI , because there is not much of that ...
0 votes
0 answers
23 views

Is there any neural network model that can perform multiple NLP steps at once?

I realize most NLP algorithms have multiple steps. (e.g. OCR/speech rec > syntax > semantics > response logic > semantic output > natural language output) Is there any NN model that can ...
0 votes
4 answers
2k views

Why does Google Translate produce two different translations for the same Chinese text?

I don't understand why Google Translate translates the same text in different ways. Here is the Wikipedia page of the 1973 film "Enter the Dragon". You can see that its traditional Chinese ...
30 votes
9 answers
7k views

What is the actual quality of machine translations?

As an AI layman, till today I am confused by the promised and achieved improvements of automated translation. My impression is: there is still a very, very far way to go. Or are there other ...
1 vote
1 answer
157 views

How could facts be distinguished from opinions?

As a software engineer, I am searching for an existing solution or, if none exists, willing to create one that will be able to process texts (e.g. news from online media) to extract/paraphrase dry ...
3 votes
1 answer
4k views

How can I leverage artificial intelligence and virtual reality to create intelligent automatic story generation?

How can I leverage artificial intelligence and virtual reality to create intelligent automatic story generation? My idea is to come up with a system that is empowering the user’s imagination to create ...
2 votes
1 answer
1k views

How can a system like Jarvis understand the commands and take actions?

I am looking to make an AI like Jarvis. A perfect real-life example of this type of system is the simple AI that Mark Zuckerberg has recently built. Here is a description of how his AI works. From ...
4 votes
2 answers
146 views

Is there a machine learning system that is able to understand mathematical problems given in a textual description?

Is there a machine learning system that is able to "understand" mathematical problems given in a textual description, such as A big cat needs 4 days to catch all the mice and a small cat ...
2 votes
1 answer
124 views

Are there any meaningful books entirely written by an artificial intelligence?

Are there any meaningful books entirely written by an artificial intelligence? I mean something with meaning, unlike random words or empty books. Something that can be charactersed as fiction ...
1 vote
2 answers
63 views

Is it possible to classify the subject of a conversation?

I would like to classify the subject of a conversation. I could classify each messages of the conversation, but I will loose some imformation because of related messages. I also need to do it ...
3 votes
0 answers
94 views

Can in principle GPT language models learn physics?

Does anyone know of research involving the GPT models to learn not only regular texts, but also learn from physics books with the equations written in latex format? My intuition is that the model ...
1 vote
0 answers
40 views

Can text-independent writer identification be done without multi-sentence training datasets for each writer?

I am trying to learn more about text-independent writer identification and was hoping for some advice. I have a folder with 100k images, each of them with a different handwritten sentence. All of the ...
1 vote
0 answers
32 views

How well can NLP techniques recognize connotations in natural languages?

What is the state of the art with respect to recognizing connotations in natural languages? For instance: Trump is a better president than Obama. [Praising] Trump is the worst president ...
1 vote
1 answer
115 views

When to use NLP, NLG and NLU in conversation agents?

I had read some blogs (like 1, 2 or 3) about what the difference between all three of them is. I am trying to build an open domain conversation agent using natural language AI. That agent can do ...
3 votes
1 answer
143 views

How can I make ELIZA more realistic?

I’ve coded a simple ELIZA chatbot for a high school coding competition. The chatbot is part of an app that’s designed to help its user cope with depression, anxiety, and similar mental health ...
1 vote
0 answers
49 views

Designing a chatbot personal project with zero coding experience, using an existing platform

My girlfriend has a masters degree in linguistics and would like to create an AI chatbot personal project to show potential employers her linguistics skills since she is struggling to find a job. ...
2 votes
1 answer
143 views

What are the challenges faced by using NLP to convert mathematical texts into formal logic?

From what I've figured (a) converting mathematical theorems and proofs from English to formal logic is a straightforward job for mathematicians with sufficient background, except that it takes time. ...
1 vote
0 answers
25 views

What are the current research trends in recognizing narrative similarity?

I am currently working on a term paper on the topic of Narrative Similarity, based on Loizos Michael's work "Similarity of Narratives". I am trying to find the latest trends within this field of study ...
7 votes
1 answer
254 views

What are the most recent and influential breakthroughs in NLP?

I'm looking at the history of NLP, starting in the 1950s, with the Georgetown–IBM experiment. What are examples of the most recent (e.g. in the last 5-10 years) and influential breakthroughs in ...
8 votes
2 answers
1k views

What are the current big challenges in natural language processing and understanding?

I'm doing a paper for a class on the topic of big problems that are still prevalent in AI, specifically in the area of natural language processing and understanding. From what I understand, the areas: ...