Questions tagged [natural-language-processing]

For questions related to natural language processing, which is concerned with the interactions between computers and human (or natural) languages, in particular how to create programs that process and analyze large amounts of natural language data.

Filter by
Sorted by
Tagged with
2
votes
0answers
10 views

Can Bert be used to extract embedding for large categorical features?

I've lot of training data points (i.e in millions) and I've around few features but the issue with that is all the features are categorical data with 1 million+ categories in each. So, I couldn't use ...
0
votes
1answer
46 views

What AI designs are suited for producing title replacements?

Problem: "For a given news article, generate another title for the article if the article is to be published under a different Publication." Which algorithm will be well suited for this? Should I use ...
1
vote
2answers
71 views

What is the difference between automatic transcription and automatic speech recognition?

What is the difference between automatic transcription and automatic speech recognition? Are they the same? Is my following interpretation correct? Automatic transcription: it converts the speech to ...
4
votes
2answers
71 views

How to use BERT as a Multi-Purpose Conversational AI?

After doing some more research, I thought I'd reframe my question a little. I’m looking to make an NLP model that can achieve a dual purpose. One purpose being that it can hold interesting ...
0
votes
1answer
32 views

Isolate the speech of two people in an audio record with two people only

I would like to find a way to isolate the speech of each of the people in an audio record so I can create a file of that form : ...
1
vote
1answer
16 views

Deep audio fingerprinting for word search

Simply speaking, I'm trying to somehow search an audio clip for a list of words, and if found, I mark the time stamps. My use-case is profanity check with a list of pre-defined profane words. Is ...
1
vote
0answers
28 views

How much knowledge of the world is learnt through words?

We know a lot of common sense about the world. Things like "to buy something you need money". I wonder how much of this common sense comes about through actual someone explicitly telling you the ...
4
votes
0answers
37 views

Is Sanskrit still relevant for NLP/AI?

I came across a news article from 2018 where the president of India was saying that Sanskrit is the best language for ML/AI. I have no idea regarding his qualification on either AI or Sanskrit to say ...
1
vote
1answer
20 views

Can a character-level Seq2Seq setup learn to perfectly reconstruct structured data like name strings?

If not perfect, how well can they do? For example, if I give the Seq2Seq setup a name it did not see in the training process, can it output the same name without error? Example ...
2
votes
1answer
94 views

How do I use neural networks to implement a chatbot?

I don't know anything about neural networks, but I got the information that making a chatbot with a neural network is very good. Is this really true? What do I need to know in order to build a chat ...
1
vote
1answer
30 views

How does transformer leverage GPU which trains faster than RNN?

How does transformer leverage GPU which trains faster than RNN? I understand the parameter space of the transformer might be significantly larger than that of the RNN. But why does the transformer ...
0
votes
1answer
42 views

Preparation of input data

Tell me why my val_acc is always the same and how to solve this problem? I saw several topics on the Internet specifically on this problem but they did not help me (for example, use SGD with different ...
1
vote
1answer
45 views

Can AI help summarize article or abstract sentence keyword?

I'm wondering if AI now can help us abstract summary or general idea of long article, for example novel or historical stories, or abstract most important keyword from sentence; Would you please tell ...
4
votes
0answers
23 views

Training an RNN to answer simple quesitons

I would like to train an RNN to follow the sentences: "Would you like some cheese"? with "Yes, I would like some cheese." So whenever the template "Would you like some ____?" appears then RNN ...
0
votes
1answer
24 views

Extract product information from email receipt HTML

I am trying to extract product information from email receipts HTML. Most services I have found focus on OCR from paper receipts or PDFs. I would imagine that extraction of product information would ...
4
votes
2answers
56 views

Does summing up word vectors destroy their meaning?

For example, I have a paragraph which I want to classify in a binary manner. But because the inputs have to have a fixed length, I need to ensure that every paragraph is represented by a uniform ...
2
votes
0answers
32 views

How can I extract the reason of the legal compensation from a court report?

I'm working on a project (court-related). At a certain point, I have to extract the reason of the legal compensation. For instance, let's take these sentences (from a court report) Order mister X ...
1
vote
2answers
98 views

Which algorithm should I use to map an input sentence to an output sentence?

I am new to NLP realm. If you have an input text "The price of orange has increased" and output text "Increase the production of orange". Can we make our RNN model to predict the output text? Or what ...
3
votes
0answers
24 views

Creating an AI than can learn to give instructions

So we think a computer is dumb because it can only follow instructions. Therefor I am trying to create an AI that can give instructions. The idea is this: Create a geometric scene (A) then make a ...
2
votes
1answer
647 views

How to make meaningful sentences from a set of words?

I have set of topics generated using LDA and like {code, language, test , write, function}, {class, public, method, string, int} etc and I want to make meaningful sentence/sentences from these words ...
2
votes
1answer
51 views

How to use AI for language recognition?

Given an audio track, I'm trying to find a way to recognize the audio language. Only within a small set (e.g. English vs Spanish). Is there a simple solution to detect the language in a speech?
4
votes
2answers
48 views

Is there any classifier that works best in general for NLP based projects?

I've written a program to analyse a given piece of text from a website and make conclusary classifications as to its validity. The code basically vectorizes the description (taken from the HTML of a ...
2
votes
0answers
71 views

Is NLP likely to be sufficiently solved in the next few years?

The reason I am asking this question is because I am about to start a PhD in NLP. So I am wondering if there would be as much job opportunities in research in industry as oppose to in academia in the ...
0
votes
2answers
107 views

Content analysis tools

We want to figure out the connection between people, based on their speech. Assume, that a conversation is a poetry with lines belongs to characters. There are a lot of poetries and the lines are ...
2
votes
0answers
35 views

What role do distractors play in natural language processing?

I’m doing research on natural language processing (NLP). I’d like to put together my own model. However, I'm running into a concept I am not familiar with, namely, distractors. A google search does ...
4
votes
1answer
99 views

Is it possible to verify SOP of call center conversation using AI?

As we know in call centers there are certain SOP(standard operating procedure), for example few are below, Agent greeted customer Agent verified the validity of customer before providing sensitive ...
1
vote
1answer
82 views

How to distinguish between proper nouns and other words in NLP?

If an NLP system processes a text containing proper nouns like names, trade marks, etc. without knowing anything about the language (ie no lexicon), is it possible to recognise them?
0
votes
0answers
15 views

How would an AI learn the concept of the words “repeat twice”?

In a hypothetical conversation: Person A - "Repeat the word 'cat' twice". Person B - "cat cat". I'm thinking about how a human or AI can learn the concept of "...
1
vote
0answers
26 views

Are there any approaches other than deep learning to deal with unexpected questions in a question answering system?

I'm working on a question answering bot as my graduation project. The main concept is having a text file with many sentences, and building a question answering bot which answers a user's question ...
2
votes
0answers
72 views

Bert super easy implementation

I myself am not new to NLP, but for some reason I am unable to grasp purity of BERT. I have seen a ton of blogs, github repos, but none could clarify BERT usage to me. It would be helpful if you ...
2
votes
1answer
51 views

Giving an AI a purpose to talk

I am trying to teach my AI to talk. The problem is I'm struggling to find a good scenario in which it needs to. Some ideas I had were: "Describe a geometric scene" - Then together with a parser we ...
2
votes
1answer
52 views

What is the best way to find the similarities between two text documents?

I would like to develop a platform in which people will write text and upload images. I am going to use Google API to classify the text and extract from the image all kinds of metadata. In the end, I ...
2
votes
1answer
105 views

How to Extract Information from the Image

I'm trying to extract some particular information from the image(png). I tried to extract the text using the below code ...
0
votes
1answer
56 views

1D convolutions, word2vec, and $n$-grams

Suppose we are using word2vec and have embeddings of individual words $w_1, \dots, w_{10}$. Let's say we wanted to analyze $2$ grams or $3$ grams. Question 1 Why would adding all the possible $\...
8
votes
1answer
123 views

What are the current big challenges in Natural Language Processing and Understanding?

I'm doing a paper for a class on the topic of big problems that are still prevalent in AI, specifically in the area of Natural Language Processing and Understanding. From what I understand, the areas: ...
0
votes
1answer
31 views

What is the most accurate pretrained sentiment analysis model by 2019?

I've been using OpenAI's 2017 Sentiment Neuron implementation (https://github.com/openai/generating-reviews-discovering-sentiment) for a while, because it was easy to set up and was the most accurate ...
1
vote
1answer
33 views

Sentiment Analysis and Logistic Regression

Suppose we want to classify a review as good ($1$) or bad ($0$). We have a training data set of $10,000$ reviews. Also suppose we have a vocabulary of $100,000$ words $w_1, \dots, w_{100,000}$. So the ...
0
votes
1answer
52 views

Need examples for the following definitions

I am currently reading the paper "Similarity of Narratives" by Loizos Michael (link below) and I am having a hard time figuring out the definitions listed (p.107 - p.109). Could someone please give ...
1
vote
1answer
47 views

How to detect any native language when written in Latin characters?

Assume somebody knows only to write in Latin characters. If they write words of any other language (example: Hindi, French, Latin) using the Latin alphabet, how can I detect that language? Example: ...
48
votes
3answers
31k views

How can neural networks deal with varying input sizes?

As far as I can tell, neural networks have a fixed number of neurons in the input layer. If neural networks are used in a context like NLP, sentences or blocks of text of varying sizes are fed to a ...
0
votes
0answers
22 views

Methods for automated insertion of emojis into text?

I want to build a deep learning algorithm that places emojis in a extended tracts of text. The intent is to choose emojis related to the meaning of the text. Where should I start? I've read that ...
1
vote
1answer
64 views

Is it possible to use the GPT-2 model for time-series data prediction?

Is it possible and how trivial (or not) might it be (if possible) to retrain GPT-2 on time-series data instead of text?
1
vote
2answers
350 views

Is it a good idea to use BERT to answer a FAQ with semantic similarity?

I have been looking for BERT for many tasks. I would like to compare the performance to answer an FAQ, using BERT semantic similarity and BERT Q/A. However, I'm not sure it is a good idea to use ...
4
votes
1answer
72 views

Will BERT embedding be always same for a given document when used as a feature extractor

When we use BERT embeddings for a classification task, would we get different embeddings every time we pass the same text through the BERT architecture? If yes, is it the right way to use the ...
2
votes
1answer
112 views

Anomaly Detection in distributed system using generated log file

I am developing an AI tool for anomaly detection in a distributed system.  The system supports an interface that combines several individual logs into a single log file generating approx. 7000 entries/...
2
votes
0answers
34 views

How can I feed any word into a neural network?

I am working on an Intent detection problem for a chatbot in Java. So I need to convert words from String to a double[] format. I tried using wordToVec(deeplearning4j), but it does not return a vector ...
11
votes
3answers
978 views

What topologies are largely unexplored in machine learning?

Geometry and AI Matrices, cubes, layers, stacks, and hierarchies are what we could accurately call topologies. Consider topology in this context the higher level geometrical design of a learning ...
2
votes
0answers
11 views

NLP annotation tool online and other tools to compare performances of different NLP algorithms

I do text annotations (POS tagging, NER, chunking, synset) by using a specific annotation tool for Natural Language Processing. I would like to make the same annotations on different tools to compare ...
4
votes
0answers
62 views

Are embeddings in multi-lingual language models comparable across languages?

Facebook has just pushed out a bigger version of their multi-lingual language model XLM, called XLM-R. My question is: do these kind of multi-lingual models imply, or even ensure, that their ...
3
votes
0answers
21 views

Why embedding layer is used in the character-level Natural Language Processing models

Problem Background I am working with a problem, which requires a character-level, deep learning model. Previously I was working with word-level deep NLP (Natural Language Processing) models, and in ...