We’re rewarding the question askers & reputations are being recalculated! Read more.

Questions tagged [natural-language-processing]

For questions related to natural language processing, which is concerned with the interactions between computers and human (or natural) languages, in particular how to create programs that process and analyze large amounts of natural language data.

Filter by
Sorted by
Tagged with
1
vote
0answers
23 views

Is there anywhere to get a free dictionary with definitions? [on hold]

An ideal thing to teach an AI about what words mean would be a dictionary (or an encyclopedia). Even better would be a child's dictionary. (i.e. "a cat is a furry animal" rather than "a cat is a type ...
2
votes
0answers
26 views

Is there a detailed description or implementation of an end-to-end speech recognition system?

I am currently trying to implement an end-to-end speech recognition system from scratch, that is, without using any of the existing frameworks (like TensorFlow, Keras, etc.). I am building my own ...
1
vote
0answers
11 views

Deep audio fingerprinting for word search

Simply speaking, I'm trying to somehow search an audio clip for a list of words, and if found, I mark the time stamps. My use-case is profanity check with a list of pre-defined profane words. Is ...
2
votes
0answers
25 views

Are embeddings in multi-lingual language models comparable across languages?

Facebook has just pushed out a bigger version of their multi-lingual language model XLM, called XLM-R. My question is: do these kind of multi-lingual models imply, or even ensure, that their ...
2
votes
1answer
26 views

What happens when the output length in the brevity penalty is zero?

The brevity penalty is defined as $$bp = e^{(1- r/c)},$$ where $r$ is the reference length and $c$ is the output length. But what happens if the output length gets zero? Is there any standard way ...
0
votes
0answers
30 views

How to create an automatic Aimbot coach?

In the gaming community an Aimbot is used to extend the human capabilities of playing a game. An average human user has only a limited capabilities of mastering a game. The amount of actions per ...
2
votes
1answer
22 views

How do you build a language model to predict the contextual similarity between two documents?

How do you build a language model to predict the contextual similarity between two documents?
1
vote
0answers
10 views

How to use TPU for real-time low-latency inference?

I use Google's Cloud TPU hardware extensively using Tensorflow for training models and inference, however, when I run inference I do it in large batches. The TPU takes about 3 minutes to warm up ...
1
vote
1answer
62 views

How to Extract Information from the png Image

I'm trying to extract some particular information from the image(png). I tried to extract the text using the below code ...
2
votes
0answers
20 views

Is there a tool to convert from the brat standoff format to CoNLL-U format?

I've been searching for a tool to convert from the brat standoff format to the CoNLL-U format, so that to use it as parsing corpus model to the spaCy library. Can you help me?
2
votes
0answers
30 views

What is the underlying model of IBM Watson Assistant and Microsoft LUIS?

As I stated in my question, I would like to know the underlying pipeline and machine learning models that are used to classify intents and identify entities in IBM Watson Assistant and Microsoft LUIS ...
1
vote
1answer
33 views

Is it possible to use the GPT-2 model for time-series data prediction?

Is it possible and how trivial (or not) might it be (if possible) to retrain GPT-2 on time-series data instead of text?
1
vote
3answers
79 views

How can neural networks be used to generate rather than classify?

In my experience with Neural Nets, I have only used them to take input vectors and return binary output. But, here in a video, https://youtu.be/ajGgd9Ld-Wc?t=214, Kai Fu Lee, renowned AI Expert shows ...
1
vote
0answers
20 views

Finetuning GPT-2 twice for particular style of writing on a particular topic

Sorry if this is a stupid question. I'm just starting out in ML and am working with gpt-2 for text generation. My situation is that I have to generate text in a particular field for eg. family ...
1
vote
0answers
19 views

Why hasn't deep learning been used for word level alignment?

I've been exploring word-level alignments tools such as MGIZA and it seems to me that there hasn't been any new tool for this problem. Are neural networks not suitable to solve this problem or simply ...
1
vote
2answers
34 views

Does it matter if it's a bot or a human generating text? Doesn't it come down to the content?

It was noted today that automated text generation is advancing at a rapid pace, potentially accelerating. As bots become more and more capable of passing turing tests, especially in single iterations,...
2
votes
0answers
21 views

How to train a transformer text-to-text model on counterexamples?

Is it possible to update the weights of a vanilla transformer model using counterexamples alongside examples? For example, from the PAWS data set, given the phrases "Although interchangeable, the ...
0
votes
0answers
10 views

How does transformer network learn to decide in a single step?

I read this In Google AI blog: link: https://ai.googleblog.com/2017/08/transformer-novel-neural-network.html S1 : " the Transformer can learn to immediately attend to the word “river” and make this ...
1
vote
2answers
48 views

Why is embedding important in NLP, and how does autoencoder work?

People say embedding is necessary in NLP because if using just the word indices, the efficiency is not high as similar words are supposed to be related to each other. However, I still don't truly get ...
0
votes
1answer
20 views

How to change this RNN text classification code to become text generation code?

I can do text classification with RNN, in which the last output of RNN (rnn_outputs[-1]) is used to matmul with output layer weight and plus bias. That is getting a word (class name) after the last T ...
2
votes
0answers
24 views

What is the State-of-the-Art open source Voice Cloning tool right now?

I would like to clone a voice as precisely as possible. Lately, impressive models have been released that only need about 10 s of voice input (cf. https://github.com/CorentinJ/Real-Time-Voice-Cloning),...
2
votes
0answers
16 views

Doubt on formulating cost function for GloVe

I'm reading the notes here and have a doubt on page 2 ("Least squares objective" section). The probability of a word $j$ occurring in the context of word $i$ is $$Q_{ij}=\frac{\exp(u_j^Tv_i)}{\sum_{w=...
2
votes
1answer
54 views

Why do you need to retrain GPT-2?

I'm following this tutorial, and I wonder why is there a train-step - why is it necessary? I thought the whole idea of GPT-2 is that you do not need to train it on specific text domain, as it's ...
7
votes
2answers
227 views

How would an AI learn idiomatic phrases in a natural language?

After an AI goes through the process described in How would an AI learn language?, an AI knows the grammar of a language through the process of grammar induction. They can speak the language, but they ...
-1
votes
1answer
121 views

Can a neural net learn to read?

I am a student of last year of computer engineering and lately I have been very interested in AI. Fields such as ML and DL seem very disruptive to me. A few months ago I saw an interview of Bill ...
3
votes
1answer
57 views

Techniques for sentence transformation and consistency

I'm looking for NLP techniques to transform sentences without affecting their meaning, and measures of textual consistency. For example, techniques that could transform active voice into passive voice,...
2
votes
2answers
57 views

Chatbot using Machine Learning vs Programming

I am currently building a chatbot. What I have done so far is, collected possible questions/training data/files and created a model out of it using Apache OpenNLP; the model is able to predict all the ...
2
votes
1answer
53 views

How does Continuous Bag of Words ensure that similar words are encoded as similar embeddings?

This is related to my earlier question, which I'm trying to break down into parts (this being the first). I'm reading notes on word vectors here. Specifically, I'm referring to section 4.2 on page 7. ...
0
votes
0answers
19 views

Understanding how continuous bag of words method learns embedded representations

I'm reading notes on word vectors here. Specifically, I'm referring to section 4.2 on page 7. First, regarding points 1 to 6 - here's my understanding: If we have a vocabulary $V$, the naive way to ...
0
votes
1answer
37 views

Preparation of input data

Tell me why my val_acc is always the same and how to solve this problem? I saw several topics on the Internet specifically on this problem but they did not help me (for example, use SGD with different ...
2
votes
2answers
41 views

Can ELMO embeddings be used to find the n most similar sentences?

Assume I have a list of sentences, which is just a list of strings. I need a way of comparing some input string against those sentences to find the most similar. Can ELMO embeddings be used to train a ...
0
votes
1answer
41 views

How to use pretrained checkpoints of BERT model on semantic text similarity task?

I am unaware to use the derived checkpoints from pre-trained BERT model for the task of semantic text similarity. ...
1
vote
2answers
43 views

What is “Word Sense Disambiguation”?

I recently came across this article which cites a paper which apparently won outstanding paper in ACL 2019. The theme is that it solved a longstanding problem called Word Sense Disambiguation. What ...
2
votes
0answers
40 views

Grouped Text classification

I have thousands groups of paragraphs and I need to classify these paragraphs. The problem is that I need to classify each paragraph based on other paragraphs in the group! For example, a paragraph ...
1
vote
3answers
47 views

Why do language models place less importance on punctuation?

I have very outdated idea about how NLP tasks are carried out by normal RNN's, LSTM's/GRU's, word2vec, etc to basically generate some hidden form of the sentence understood by the machine. One of the ...
1
vote
0answers
6 views

How can we use Dependency Parsers for Negation detection

I am building a negation detection system. How to use dependency parsers for the same. I am using SPACY for dependency parser
0
votes
0answers
41 views

How do I do further (domain-specific) pre-training with Google BERT in preparation for subsequent fine-tuning?

How do I do further (domain-specific) pre-training with Google BERT in preparation for subsequent fine-tuning? Another way to say this is: can you create a checkpoint file created from the final ...
1
vote
0answers
17 views

Language Model from missing data

I want to learn how a set of operations (my vocabulary) are composed in a dataset of algorithms (corpus). The algorithms are a sequence of higher level operations which have varying low-level ...
2
votes
0answers
52 views

Machine learning methods to identify the recipient of a document?

I need some advice on what AI methods would be suited to the identification of a recipient of a document, where the format of the documents may vary.
0
votes
0answers
20 views

How can I do entity recognition given the features?

I constructed the features from this tutorial: https://sklearn-crfsuite.readthedocs.io/en/latest/tutorial.html#features. But I did not understand the process of making the model. After doing the ...
3
votes
0answers
22 views

Can computers recognise “grouping” from voice tonality?

In human communication, tonality or tonal language play many complex information, including emotions and motives. But excluding such complex aspects, tonality serves some a very basic purpose of "...
2
votes
0answers
63 views

What is a conditional random field?

I new in machine learning, especially in Conditional Random Fields (CRF). I have read several articles and papers and in there is always associated with HMM and sequences classification. I don't ...
2
votes
0answers
28 views

Models to extract Causal Relationship between entities in a document using Natural Language Processing techniques

I am looking to extract causal relations between entities like Drug and Adverse Effect in a document. Are there any proven NLP or AI techniques to handle the same. Also are there ways to handle cases ...
1
vote
1answer
45 views

How do I classify strings with possibly no meaning?

I am quite new to text classification. Using EAST text detection model, I get multiple strings that aren't words and most often have no meaning. For example, IDs, brand names, etc. I would like to ...
0
votes
1answer
32 views

Is there any way to classify Document Image without OCR?

I have multiple invoices images which need to classify invoice types such as fright, utility, goods, etc. Is there any way to classify without OCR?
4
votes
1answer
92 views

How can I build an AI with NLP that read stories

I want to do an NLP project but I don't know if it's doable or not as I have no experience or knowledge in NLP or ML yet. The idea is as follows: Let's say we have a story (in the text) that has 10 ...
1
vote
1answer
41 views

Do I need to use a pre-processed dataset to classify comments?

I want to use Machine Learning for text classification, more precisely, I want to determine whether a text (or comment) is positive or negative. I can download a dataset with 120 million comments. I ...
1
vote
0answers
23 views

Conversational AI

I'm wondering if anyone knows about any projects that break down conversations for an AI. I'll explain what I mean - I've seen a lot of hardcoded responses, but nothing that allows an AI to break a ...
0
votes
0answers
85 views

How Seq2Seq with Bidirectional RNN works?

First of all the scope of the question is as follows - we have Sequence2Sequence architecture with: Decoder: Bidirectional LSTM Encoder: regular (single directional) LSTM What I know: When you ...
1
vote
1answer
61 views

How to distinguish between proper nouns and other words in NLP?

If an NLP system processes a text containing proper nouns like names, trade marks, etc. without knowing anything about the language (ie no lexicon), is it possible to recognise them?