Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [natural-language-processing]

Natural language processing is the computer representation and manipulation of human languages that developed in social (rather than mathematical or other) contexts. Use the natural-language tag for questions not primarily about processing, and use the language-processing tags for questions that are about the processing of languages that are not naturally formed.

1
vote
0answers
9 views

Skip-Gram Model Training

Suppose we want to predict context words $w_{i-h}, \dots, w_{i+h}$ given a target word $w_i$ for a window size $h$ around the target word $w_i$. We can represent this as: $$p(w_{i-h}, \dots, w_{i+h}|...
0
votes
0answers
20 views

Facebook's Dr QA with multiple choice questions?

Is there such a thing as Facebook's Dr QA with multiple choice questions? Where the algorithm selects the most likely from 3 possible responses? The idea is to solve the following problem ...
0
votes
0answers
13 views

What are the reference papers of image captioning model 'all_img', 'att2in2', 'adaattmo' and 'topdown'?

I Want to cite the reference paper of The models appeared in this webpage: https://github.com/ruotianluo/ImageCaptioning.pytorch/blob/master/models/init.py But which papers do these four models '...
0
votes
0answers
6 views

How to manipulate/transform recurrent CNN for sentence classification?

I learned how to build recurrent cnn model for text classification and sketched out my initial implementation. However, I am wondering how to transform recurrent <...
1
vote
1answer
58 views

Is Reinforcement Learning the future of Natural Language Processing?

I was reading about the grounding problem after seeing it mentioned in another answer today. The article states that, in order to avoid the "infinite regress" of defining all words with other words, ...
0
votes
0answers
17 views

Graphical authorship attribution project

As a suggested project for my question here, I have got an idea of creating a simple authorship attribution application, which is a sub-task of this open-source project. More formally, the ...
-1
votes
0answers
27 views

How to Translate words?

I want to write a program that will figure out translations of words from one language to another just by reading texts. Can you see anything wrong with this approach: We make all possible ...
2
votes
1answer
44 views

How to implement Neural Network in chatbot

I don't know anything about the neural network, but I get information that making a chatbot with a neural network is very good. So what do you think for people who are new to machine learning to ...
2
votes
1answer
48 views

Which matrix represents the similarity between words when using SVD?

Two words can be similar if they co-occur "a lot" together. They can also be similar if they have similar vectors. This similarity can be captured using cosine similarity. Let $A$ be a $n \times n$ ...
0
votes
0answers
15 views

Detecting an entity (location) in a text, using a corpus of smaller texts

I have a corpus of around 2000 texts, that are relatively short (+- 150 words). All of these texts are news articles about accidents that happened in the Netherlands. I'd like to extract the exact ...
0
votes
1answer
19 views

1D convolutions, word2vec, and $n$-grams

Suppose we are using word2vec and have embeddings of individual words $w_1, \dots, w_{10}$. Let's say we wanted to analyze $2$ grams or $3$ grams. Question 1 Why would adding all the possible $\...
0
votes
0answers
18 views

BERT intermediate layer utility

I'm looking for the BERT model you can find here. As I look to the attention mechanism, I don't understand why in the BERT encoder we have an intermediate layer between the attention and neural ...
1
vote
0answers
9 views

How to perform unsupervised anomaly detection from log file with mostly textual data?

I have a log file of the format, Index, Date, Timestamp, Module, App, Context, Session, Verbosity level, Description The log file can be considered as a master log, which consists of individual ...
0
votes
0answers
10 views

Word vector representation for feature extraction from log file

I am trying to generate a word vector representation of the textual descriptions of events from the log file in a distributed system. The logged events are time series data and correlated. During the ...
0
votes
1answer
20 views

Sentiment Analysis and Logistic Regression

Suppose we want to classify a review as good ($1$) or bad ($0$). We have a training data set of $10,000$ reviews. Also suppose we have a vocabulary of $100,000$ words $w_1, \dots, w_{100,000}$. So the ...
0
votes
0answers
9 views

Training Data of $n$-gram Language Models

Suppose $\textbf{w} = (w_1, \dots, w_k)$ is a sequence of words $w_1, \dots ,w_k$. Suppose we want to find $p(\textbf{w})$. In an $n$-gram language model, $$p(\textbf{w}) = \prod_{i=1}^{k+1} p(w_{i}|...
0
votes
1answer
28 views

What do the vectors of the center and outside word look like in word2vec?

In word2vec, the task is to learn to predict which words are most likely to be near each other in some long corpus of text. For each word $c$ in the corpus, the model outputs the probability ...
0
votes
0answers
9 views

Requirement Traceability

In my project I have around 10K requirements and 60K test cases. I would like to use some AI techniques to handle the requirement to Test case mapping. I don't know which AI methos or techniques I ...
0
votes
0answers
21 views

Extract personal information about a person from a list of documents and summarize it

I need to extract personal information about a person from a list of documents and summarize it to the user. If there are 2 people with the same name, the correct person should be identified. If the ...
1
vote
0answers
20 views

How much the dialects recognition and speech recognition are relevant?

In this tutorial, they build a speech recognition model to classify a one-second audio clip as one of ten predefined words. Suppose that we modified this problem as the following: Given an Arabic ...
0
votes
0answers
28 views

Is the difficulty of using deep learning for natural language processing depend on the language of the dataset?

I aim to learn deep learning for natural language processing to use it as a core idea in my final year project, and I have to use an Arabic text/speech dataset. However, most online courses deal with ...
2
votes
0answers
22 views

Translate product names with AI

I frequently need to translate product names for hundreds of similar products -- and I have a list of past product names. Is it possible to train AI to review past translations and translate? It doesn'...
1
vote
0answers
59 views

Dialects classification using deep learning

Dialects differ a lot between cities in my country, Syria. People sometimes express themselves using different local phrases and idioms which refer to the same topic. So, I came up with the idea of ...
0
votes
0answers
22 views

Isolate the speech of two people in an audio record with two people only

I would like to find a way to isolate the speech of each of the people in an audio record so I can create a file of that form : ...
0
votes
0answers
21 views

How do the Sine and Cosine functions encode position in the “Attention is All You Need” paper?

After going through both the "Illustrated Transformer" and "Annotated Transformer" blog posts, I still don't understand how the sinusoidal encodings are representing the position of elements in the ...
1
vote
0answers
35 views

How can/should I use AI to populate a game (in the game theory sense) from text input

I'm wanting to conduct game theoretic analyses of ongoing conflict situations (e.g. the US/North Korea negotiations; Syrian conflict; etc) as reported in the news media. I believe that AI may help me ...
2
votes
3answers
92 views

A Sentence with Different Parse Tree Structures

I just read about Parse Tree for parsing a sentence as an Input for NLP Task. In my understanding, a valid Parse Tree of a sentence should have be validated by linguistic expert. So, I concluded, a ...
1
vote
0answers
22 views

Current status of semantics in natural language

It seems to me that current work in semantics of natural language processing is based on Tarski's book such as "Logic, Semantics, Metamathematics; Papers From 1923 To 1938", which is far from ...
1
vote
1answer
33 views

How to make chatbot using NLP like Dialogflow?

I want to apply the concept that exists in the Dialogflow API in my e-commerce website. I get some references in this regard : Tokenization Part Of Speech Named Entity Recognition Rule based I ...
0
votes
0answers
22 views

NLP Task Proposal: I spy with my little eye

I order to build better artifical agents (AA) we need the right tasks and data to train on. The task I have in mind is the well-know game "I spy with my little eye", where agent A has to guess the ...
5
votes
1answer
76 views

How do we know if GPT-2 is a better language model?

You may have heard of GPT2, a new language model. It has recently attracted attention from the general public as the foundation that published the paper, OpenAI, ironically refused to share the whole ...
1
vote
1answer
33 views

Anomaly Detection in distributed system using generated log file

I am developing an AI tool for anomaly detection in a distributed system.  The system supports an interface that combines several individual logs into a single log file generating approx. 7000 entries/...
4
votes
0answers
37 views

What is the motivation for row-wise convolution and folding in Kalchbrenner et al. (2014)?

I was reading the paper by Kalchbrenner et al. titled A Convolutional Neural Network for Modelling Sentences and I am struggling to understand their definition of convolutional layer. First, let's ...
0
votes
1answer
20 views

Detect named entities inside words using spaCy

I am using rasa nlu for training an NLU system to detect intents and slots. Now, some languages have word endings with their nouns (like Finnish, e.g. "in Berlin" -> "Berliinissä"). I have tried to ...
0
votes
0answers
14 views

What is the right way to convolve over word embeddings?

I have two word embeddings w1 and w2 with dimension 100 as input into my convolutional neural network. It should learn the similarity between these two words. I am now concerned with the applied ...
0
votes
2answers
34 views

Do I need an encoder-decoder architecture to predict the next item of a sequence?

I am trying to understand how RNNs are used for sequence modelling. On a tutorial here, it mentions that if you want to translate say a sentence from English to French you can use an encoder-decoder ...
-1
votes
0answers
9 views

Forced coherence and quantum leaps to optimize natural language understanding

Disclaimer : This is my first question on this site so I apologize if it doesn't fit the general policy. Years ago I had the idea of introducing the Lex function (standing for law in Latin or a ...
1
vote
2answers
64 views

Is there a way to understand the type of a sentence?

I am a beginner, just started studying around NLP, specifically various language models. So far, my understanding is that - the goal is to understand/produce natural language. So far the methods I ...
1
vote
0answers
17 views

How to train chat bot on infinite non-stationary data?

I have continual simulated data of million sentences of two simulated persons talking to each other in a room and I want to model one of the persons speech. Now, during this period things in the room ...
1
vote
0answers
14 views

How to annotate a teleoperated robot?

Most robotics challenges like Robocup soccer, micromouse and the Amazon picking challenge are oriented on fully autonomous systems. A motion controller gets started, the operator takes away his hands ...
0
votes
0answers
7 views

Any research that proposes ways to improve a semantic network from phonetic sequences?

Inputs: Time series of spectra representing human speech Semantic network (as a directed graph) associations Outputs: Modified version of the semantic network input Edge types in the graph (...
0
votes
1answer
98 views

BERT - What are the segment and position embeddings used in here?

They only reference in the paper that the position embeddings are learned, which is different from what was done in ELMo. ELMo paper - https://arxiv.org/pdf/1802.05365.pdf BERT paper - https://arxiv....
0
votes
1answer
48 views

What's the commercial usage of “image captioning”?

If "image captioning" is utilized to make a commercial product, what application fields will need this technique? And what is the level of required performance for this technique to be usable?
1
vote
0answers
22 views

Smielapp design feasible now?

Consider a SmielApp1, pronounced smile-app. It's a proposed app for Android, iOS, LINUX, and other phone, tablet, laptop, and desktop environments.2 The system requirements are a microphone, a speaker,...
3
votes
1answer
17 views

Natural language recommendation system: to pre-classify inputs or not?

Does it help to "pre-classify" natural language inputs using labeled input fields? E.g., "Who," "What," "Where," "When," "Why," "How," and "How much?" Or is a single, monolithic, free-form, long-text ...
4
votes
4answers
135 views

Asking about the combination of NLP and ML

I am new to this community, I just have a question : is doing a M.S. in the combination of Natural Language Processing and Machine Learning worth it? What are the opportunities that can be opened by ...
3
votes
2answers
114 views

How to recognise metaphors in NLP?

Is there software available which can extract metaphors from texts? eg: His words cut deeper than a knife. Or a simpler form like : eg: Life is a journey that must be travelled no matter how bad ...
-1
votes
1answer
39 views

What is the easiest way to model dialogue?

I am looking for some non-ML methods. I am looking for a way of two chat bots communicating to each other on specific topic. I could not find online any resources that do this without using ML. The ...
2
votes
1answer
56 views

Handling emotion in informal text (Hi vs HIIIIII!!!!)?

This is a question related to Neural network to detect "spam"?. I'm wondering how it would be possible to handle the emotion conveyed in text. In informal writing, especially among a ...
0
votes
1answer
26 views

LSTM language model not working

I am trying to use a Keras LSTM neural network for character level language modelling. As the input, I give it the last 50 characters and it has to output the next one. It has 3 layers of 400 neurons ...