Skip to main content
Share Your Experience: Take the 2024 Developer Survey

Questions tagged [natural-language-understanding]

For questions related to natural language understanding (NLU), which is a subtopic of natural language processing (NLP) that deals with machine reading comprehension. Natural-language understanding is considered a hard problem.

Filter by
Sorted by
Tagged with
0 votes
1 answer
101 views

What language model can convert normal text to JSON data

I have tried training T5-small, T5-base and T5-Large on around 15K rows of data where input data was something like but I did not get desired results ...
Arjun Singh's user avatar
0 votes
0 answers
24 views

Chat with your DB: How to get AI to follow your rules?

Context/Background: I have a single table in MySQL with info on 'members', including things like location, favourite types of music, favourite camping spots, etc. Required Behaviour: I need the system ...
Blue Da Noob's user avatar
0 votes
0 answers
16 views

Can you recommend a free AI tool to search a long list of PDFs with simple queries?

I'm planning to use AI for a research project on health data. At my organisation, there is a huge quantity of detailed patient reports in PDF format (written in German) that contain unstructured data, ...
Nereus's user avatar
  • 101
0 votes
1 answer
93 views

How does chatgpt interpret prompts? [closed]

First of all, my English isn't very good, please bear with me. I've heard that chatgpt is a decoder-only model, which doesn't use any encoder model. How does it interpret our prompts if it doesn't use ...
duh's user avatar
  • 11
0 votes
2 answers
140 views

Why encoders are required in Transformers

In the original Transformers paper why encoder is added when a decoder alone can do what an encoder can do (like multi-head attention, feed-forward NN etc....). I mean even a decoder also has the same ...
Swastik's user avatar
  • 101
0 votes
1 answer
99 views

How can I use Artificial Intelligence to compare to paragraphs to see if they share the same meaning?

I am looking for a way to compare two paragraphs and see if both share the same meaning. For example, these two paragraphs have the same meaning, but they are worded differently. Paragraph 1: The ...
Jay's user avatar
  • 101
0 votes
0 answers
10 views

What would be the best approach to resume longer texts in one word?

I am trying to create a model capable of resuming longer texts (my dataset has up to 140 words for each instance) in a single word (or multiple separate words). The idea is to synthetize positive or ...
Victor Ferreira's user avatar
6 votes
2 answers
574 views

How does GPT-based language model like ChatGPT determine the n-th letter of a word?

I understand that GPT models process input text by converting words into tokens and then embedding vectors and do not process them letter by letter. Given this approach, I am curious to know how a ...
Peyman's user avatar
  • 574
4 votes
1 answer
146 views

What puts the "chat" in a system like ChatGPT?

So I read Wolfram's What Is ChatGPT Doing … and Why Does It Work? but it left one really big question in my mind. His summary [if it could be called that!] really emphasizes that the core model is ...
natevw's user avatar
  • 141
39 votes
7 answers
16k views

Is the "Chinese room" an explanation of how ChatGPT works?

Sorry if this question makes no sense. I'm a software developer but know very little about AI. Quite a while ago, I read about the Chinese room, and the person inside who has had a lot of training/...
Guntram Blohm's user avatar
3 votes
1 answer
237 views

What is the "state of the art" in (at least partially) symbolic/logic-based chat bots/AI assistants?

ChatGPT has had a lot of buzz around it recently, and for good reason. It has shown some amazing capabilities in responding to new information, as well as in generalizing new information that has been ...
Nathan BeDell's user avatar
3 votes
1 answer
11k views

Does chatGPT learn or remember from (public) user input? Will it 'fess up to it? I could not get it to reveal [closed]

It started with a question inspired by this video: New Research Suggests to Put AI to Sleep https://youtu.be/0yuQlbCkTJ0 She says: "In this video I discuss a new research paper which suggest a ...
Ectosoprophilous's user avatar
4 votes
0 answers
3k views

How is ChatGPT maintaining context?

It has been suggested in the answer to this earlier question that it is just remembering a certain amount of recent information. The reference used is this post by OpenAI which says that ChatGPT ...
Kay999's user avatar
  • 41
4 votes
4 answers
4k views

How does ChatGPT respond to novel prompts and commands?

So I understand how a language model could scan a large data set like the internet and produce text that mimicked the statistical properties of the input data, eg completing a sentence like "eggs ...
ak0000's user avatar
  • 205
24 votes
4 answers
12k views

How does ChatGPT know math?

ChatGPT is a language model. As far as I know and If I'm not wrong, it gets text as tokens and word embeddings. So, how can it do math? For example, I asked: ME: Which one is bigger 5 or 9. ChatGPT: ...
Peyman's user avatar
  • 574
54 votes
2 answers
47k views

How does ChatGPT retain the context of previous questions?

One of the innovations with OpenAI's ChatGPT is how natural it is for users to interact with it. What is the technical enabler for ChatGPT to maintain the context of previous questions in its answers? ...
milez's user avatar
  • 981
1 vote
0 answers
60 views

How to develop an Entity linking system able to detect custom entities?

I am trying to build an entity linking system that links entities found in a text to entities on Wikipedia. If no Wikipedia page seems to match this entity, the systems will assume to have found a new ...
Giovanni Del Gallo's user avatar
1 vote
0 answers
27 views

Are custom tokens better than punctuation pseudo-tokens for LLMs?

I've seen two approaches for introducing custom tokens for transfer learning with large language models like Bert or GPT3. Some approaches introduce new tokens into the vocabulary and learn embeddings ...
A Tyshka's user avatar
  • 111
0 votes
1 answer
139 views

What is the role of self loop in Hidden Markov Models(HMM)?

What actually does the self-loop (within the single hidden state ) in the Hidden Markov model helpful for? I learn that one of the use cases concerning Natural language Understanding is that it helps ...
Pam Cesar's user avatar
1 vote
0 answers
196 views

How do I preload a conversational AI assistant like GPT-3 with complex relational data to draw on?

I'm exploring options to build a virtual assistant type of product. Creating good dialog is mostly solved with GPT-3 or even DialoGPT. My main question is how do I add larger amounts of relational ...
Sam7's user avatar
  • 111
0 votes
5 answers
1k views

How do I use A.I. to analyse & score news articles?

I'm working on a project that would benefit from using A.I. or machine learning to analyse news feeds from a variety of websites and grade each article between 0 and 10. We would manually grade ...
Nxlevel's user avatar
  • 109
2 votes
1 answer
86 views

How might AI analyze abusive discussion using natural language grammar?

Opening thoughts This does not only apply to SE comments, but the idea in general. This is not a Question for Linguistics.SE; those Questions might come later, after AI analysis. Example Linguistics ...
Jesse's user avatar
  • 123
1 vote
2 answers
43 views

Among N documents, how to summarize the most unique content in each document?

I now have $N$ documents, which share common content and they have special unique content. Say I have $3$ legal documents related to the same person. Document $A$ is about land law, document $B$ is ...
fuyutsuki's user avatar
1 vote
0 answers
33 views

Is there something like person-specific sentiment analysis?

Sentiment analysis, as we know, measures "Cake sucks" as say -0.4, and "Cake is great" as 0.7. What I'm looking for is something a bit different like so: Given input text data ...
Hmm's user avatar
  • 111
2 votes
1 answer
1k views

How to measure the similarity the pronunciation of two words?

I would like to know how I could measure the pronunciation of two words. These two words are quite similar and differ only in one vowel. I know there is, e.g., the Hamming distance or the Levenshtein ...
Ben's user avatar
  • 205
1 vote
0 answers
176 views

What is the best way to generate German paraphrases?

What is the best method to generate German paraphrases? The state-of-the-art are seq2seq transformer models, like T5, but they only work for English sentences. I found the multilingual MT5 model, but ...
lattenjoe's user avatar
1 vote
0 answers
77 views

Text matching: fuzzy names matching with learning

I'm new to AI/ML and I want to research and learn about techniques that could help me to solve this complex task. Any hint would be appreciated. Let me explain it with an example: Let's look at two ...
Bad Pitt's user avatar
  • 111
1 vote
0 answers
21 views

Can unsupervised models learn something from cat vocalizations?

I love cats, and over the years have noticed that they have recurrent patterns of vocalizations. For example, upon seeing a bird, a cat may start chittering, but the same cat would never chitter at ...
Alex Stone's user avatar
-1 votes
1 answer
38 views

Extracting values from text based on keywords

I am trying to read a PDF file and put it in Python string and trying to fetch information based on keywords. The text here is completely irregular. Example of text Blockquote Ram has taken an ...
Parnav's user avatar
  • 1
3 votes
1 answer
184 views

How would one disambiguate between two meanings of the same word in a sentence?

The boy lifted the bat and hit the ball. In the above sentence, the noun "bat" means the wooden stick. It does not mean bat, the flying mammal, which is also a noun. Using NLP libraries to ...
Yoker's user avatar
  • 131
0 votes
0 answers
25 views

Is there any neural network model that can perform multiple NLP steps at once?

I realize most NLP algorithms have multiple steps. (e.g. OCR/speech rec > syntax > semantics > response logic > semantic output > natural language output) Is there any NN model that can ...
stackypants's user avatar
1 vote
1 answer
243 views

What dataset might Elon Musk's Dall-E have used?

Dall-E, it can generate many imaginative images from the description, even some peculiar images, how did they actually create this kind of dataset to train this AI , because there is not much of that ...
Gavin's user avatar
  • 49
1 vote
2 answers
641 views

How to extract parameters from a text using AI/NLP

lets say I have three texts: "make a heading that says hello word" "make a heading of hello world" "create heading consist of hello world" How can I fetch those groups ...
ukasha sohail's user avatar
1 vote
1 answer
3k views

What is MNLI-(m/mm)?

I came across the term MNLI-(m/mm) in Table 1 of the paper BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. I know what MNLI stands for, i.e. Multi-Genre Natural ...
Marc-Philipp Knechtle's user avatar
2 votes
1 answer
172 views

Are there any meaningful books entirely written by an artificial intelligence?

Are there any meaningful books entirely written by an artificial intelligence? I mean something with meaning, unlike random words or empty books. Something that can be charactersed as fiction ...
Joe Jobs's user avatar
  • 121
3 votes
1 answer
125 views

Is there a complement to GPT/2/3 that can be trained using supervised learning methods?

This is a bit of a soft question, not sure if it's on topic, please let me know how I can improve it if it doesn't meet the criteria for the site. GPT models are unsupervised in nature and are (from ...
user6916458's user avatar
1 vote
2 answers
86 views

Is it possible to classify the subject of a conversation?

I would like to classify the subject of a conversation. I could classify each messages of the conversation, but I will loose some imformation because of related messages. I also need to do it ...
Benjamin Binard's user avatar
1 vote
1 answer
492 views

How could facts be distinguished from opinions?

As a software engineer, I am searching for an existing solution or, if none exists, willing to create one that will be able to process texts (e.g. news from online media) to extract/paraphrase dry ...
Greendrake's user avatar
4 votes
0 answers
341 views

Can in principle GPT language models learn physics?

Does anyone know of research involving the GPT models to learn not only regular texts, but also learn from physics books with the equations written in latex format? My intuition is that the model ...
Wolphram jonny's user avatar
1 vote
0 answers
307 views

How homographs is an NLP task can be treated?

A homograph - is a word that shares the same written form as another word but has a different meaning. They can be even different parts of speech. For example: close(verb) - close(adverb) lead(verb)...
spiridon_the_sun_rotator's user avatar
2 votes
1 answer
103 views

How to predict the "word" based on the meaning in a document?

What I mean to say is For example, if I give the meaning of Apple from the dictionary as input to the program, it should give output as Apple. Or I say My day to day job involves monitoring and ...
Sid's user avatar
  • 121
8 votes
2 answers
6k views

How is the F1 score calculated in a question-answering system?

I have an NLP model for answer-extraction. So, basically, I have a paragraph and a question as input, and my model extracts the span of the paragraph that corresponds to the answer to the question. I ...
HLeb's user avatar
  • 579
1 vote
0 answers
49 views

Can text-independent writer identification be done without multi-sentence training datasets for each writer?

I am trying to learn more about text-independent writer identification and was hoping for some advice. I have a folder with 100k images, each of them with a different handwritten sentence. All of the ...
user38553's user avatar
1 vote
1 answer
167 views

When to use NLP, NLG and NLU in conversation agents?

I had read some blogs (like 1, 2 or 3) about what the difference between all three of them is. I am trying to build an open domain conversation agent using natural language AI. That agent can do ...
Hiren Namera's user avatar
3 votes
1 answer
236 views

How can I make ELIZA more realistic?

I’ve coded a simple ELIZA chatbot for a high school coding competition. The chatbot is part of an app that’s designed to help its user cope with depression, anxiety, and similar mental health ...
PerplexedDimension's user avatar
1 vote
0 answers
60 views

Designing a chatbot personal project with zero coding experience, using an existing platform

My girlfriend has a masters degree in linguistics and would like to create an AI chatbot personal project to show potential employers her linguistics skills since she is struggling to find a job. ...
NaturalBornCamper's user avatar
1 vote
0 answers
41 views

How well can NLP techniques recognize connotations in natural languages?

What is the state of the art with respect to recognizing connotations in natural languages? For instance: Trump is a better president than Obama. [Praising] Trump is the worst president ...
Ray Butterworth's user avatar
2 votes
1 answer
90 views

How would you build an AI to output the primary concept of a paragraph?

My thinking is you input a paragraph, or sentence, and the program can boil it down to the primary concept(s). Example: Input: Sure, it would be nice if morality was simply a navigation toward ...
Otherness's user avatar
  • 285
2 votes
1 answer
239 views

What are the challenges faced by using NLP to convert mathematical texts into formal logic?

From what I've figured (a) converting mathematical theorems and proofs from English to formal logic is a straightforward job for mathematicians with sufficient background, except that it takes time. ...
ghosts_in_the_code's user avatar
1 vote
0 answers
27 views

What are the current research trends in recognizing narrative similarity?

I am currently working on a term paper on the topic of Narrative Similarity, based on Loizos Michael's work "Similarity of Narratives". I am trying to find the latest trends within this field of study ...
JavaApprentice's user avatar