Questions tagged [natural-language-processing]

For questions related to natural language processing (NLP), which is concerned with the interactions between computers and human (or natural) languages, in particular how to create programs that process and analyze large amounts of natural language data.

Filter by
Sorted by
Tagged with
0
votes
0answers
6 views

What are the current research trends in recognizing narrative similarity?

I am currently working on a term paper on the topic of Narrative Similarity, based on Loizos Michael's work "Similarity of Narratives". I am trying to find the latest trends within this field of study ...
1
vote
0answers
9 views

Building a template based NLG system to generate a report from data

I am a newbie to NLP and NLG. I am tasked to develop a system to generate a report based on a given data table. The structure of the report and the flow is predefined. I have researched on several ...
1
vote
1answer
22 views

Is text preprocessing really all that necessary for NLP?

As a first step in many NLP courses, we learn about text preprocessing. The steps include lemmatization, removal of rare words, correcting typos etc. But I am not so sure about the actual ...
1
vote
1answer
26 views

What are the pros and cons of supervised, semi-supervised and unsupervised relation extraction in NLP?

I am following the NLP course taught by Dan Jurafsky. In the video lectures Supervised Relation Extraction and Semi Supervised and Unsupervised Relation Extraction Jurafsky explains supervised, semi-...
0
votes
0answers
27 views
+100

Can you train Transformers sequentially?

I’m currently trying to train a BART, which is a denoising Transformer created by Facebook researchers. Here’s my Transformer code ...
2
votes
1answer
44 views

What are pros and cons of Bi-LSTM as compared to LSTM?

What are the pros and cons of LSTM vs Bi-LSTM in language modelling? What was the need to introduce Bi-LSTM?
0
votes
1answer
22 views

Which NLP application that supports recurrent neural network?

Some of the NLP applications taken from this link NLP Applications: Machine Translation Speech Recognition Sentiment Analysis Question Answering Automatic Summarization Chatbots Market Intelligence ...
3
votes
1answer
86 views

Detailed resource for a naive example-based machine translation algorithm

I'm looking to develop a machine translation tool for a constructed language. I think that the example-based approach is the most suitable because the said language is very regular and I can have a ...
2
votes
1answer
47 views

What are the main differences between skip-gram and continuous bag of words?

The skip-gram and continuous bag of words (CBOW) are two different types of word2vec model. What are the main differences between them? What are the pros and cons of both methods?
1
vote
0answers
17 views

What are the advantages and disadvantages of extrinsic and perplexity model evaluation in NLP?

In the video Evaluation and Perplexity by Dan Jurafsky, the author talks about extrinsic and perplexity evaluation in the context of natural language processing (NLP). What are the advantages and ...
4
votes
2answers
62 views

Why is dialogue a hard problem in natural language processing?

I've just started learning natural language processing from Dan Jurafsky's videos lectures. In that video, minute 4:56, he is stating that dialogue is a hard problem in natural language processing (...
2
votes
1answer
37 views

What is the current state-of-the-art in unsupervised cross-lingual representation learning?

What is the current state-of-the-art in unsupervised cross-lingual representation learning?
1
vote
0answers
15 views

Pre-trained Models for Topic Modelling Transfer Learning (LDA)

I've been searching online - and so far, I've been unable to find any publicly-accessible pre-trained models that can be used for LDA Topic Modeling - Transfer Learning. Can anyone share any ...
1
vote
0answers
13 views

What algorithm to use for finding artists/bands in text and differentiating between artists that share the same name

Here's the data I have: Text from articles from various music blogs & music news sites (title, summary, full content, and sometimes tags). I used a couple different NLP/NER tools (nltk, ...
1
vote
1answer
38 views

Owner Search for given Server SNO

I am newbie to NLP. I have a excel sheet with following columns: Server_SNo, Owner, Hosting Dept, Bus owner, Applications hosted, Functionality, comments a. Except ...
1
vote
0answers
16 views

Error: AttributeError: module 'transformers' has no attribute 'TFBertModel' [migrated]

I am applying transfer learning with the python framework (PyTorch). I am getting the below error, when loading a PyTorch pre-trained model in Google Colab. After changing the code 1 to be as code 2, ...
2
votes
1answer
38 views

Need help with this page from Graph Theory book

I am working through the textbook "Graph-Based Natural Language Processing and Information Retrieval" where I've got a question on implementation of this first Latex looking formula/algorithm. Can ...
1
vote
0answers
37 views

Use cases for AI inside the software company

This question is a bit philosophic and is about making new use cases for software companies. Let me describe what exist for now, why it is not enough, and what is needed. I know that there are a lot ...
1
vote
0answers
22 views

Is it possible to do token classification using a model such as GPT-2?

I am trying to use PyTorch's transformers as a part of a research project to do sentiment analysis of several types of review data (laptop and restaurant). To do this, my team is taking a token-...
1
vote
0answers
13 views

How positional encoding works?

In transformer model; to incorporate positional information of texts the researchers have added a positional encoding to the model. How is positional encoding works? How positional encoding system ...
1
vote
1answer
23 views

Is it recommended to remove stop words before named entity recognition?

Removing stop words can significantly speed up named entity recognition (NER) modeling by reducing the number of tokens in a document. Are stop words critical to get correct NER performance?
1
vote
1answer
21 views

Why is the sample size of stochastic gradient descent a power of 2?

I watched in the video lecture of cs224: Stanford CS224N: NLP with Deep Learning | Winter 2019 | Lecture 2 – Word Vectors and Word Senses. They take the sample size of the window to be $2^5 = 32$ or $...
0
votes
1answer
12 views

Pros and Cons of Seq2Seq vs Bidirectional RNN

It seems to me that Seq2Seq models and Bidirectional RNNs try to do the same thing. Is that true? Also, when would you recommend one setup over another? Thanks!
1
vote
1answer
18 views

Why I have a different number of terms in word2vec and TFIDF? How I can fix it?

I need multiply the weigths of terms in TFIDF matrix by the word-embeddings of word2vec matrix but I can't do it because each matrix have a different number of terms. I am using the same corpus for ...
1
vote
1answer
35 views

Is it possible to derive meaning from text by providing multiple ways of saying the same thing to a neural network?

Let's say I feed a neural network with multiple string sentences that mean roughly the same thing but are formulated differently. Will the neural network be able to derive patterns of meaning in the ...
0
votes
1answer
65 views

Why is my loss (binary cross entropy) converging on ~0.6? (Task: Natural Language Inference)

I’m trying to debug my neural network (BERT fine-tuning) trained for natural language inference with binary classification of either entailment or contradiction. I've trained it for 80 epochs and its ...
0
votes
1answer
17 views

Are POS tagging, Chunking, Disambiguation, etc. subtasks of annotation?

I wonder about the legitimacy of using the terms "POS tagging", "Chunking", "Disambiguation" and "Categorization" to describe an activity that doesn't include writing code and database queries, or ...
1
vote
0answers
13 views

Simple sequential model with LSTM which doesn't converge

I'm actually trying to create a sequential neural network in order to translate a "human" sentence in a "machine" sentence understandable by an algorithm. Like It didn't work, I've try to create a NN ...
1
vote
1answer
20 views

Using word embedding to extend words for searching POI names

I am developing my own mobile app related to digital map. One of the functions is searching POIs (points of interest) in the map according to relevance between user query and POI name. Besides the ...
0
votes
1answer
33 views

When is it time to switch to deep neural networks from simple networks in text classification problems?

I did an out of domain detection task (as a binary classification problem) and tried LR and Naive Bayes and BERT but the deep neural network didn't perform better than LR and NB. For the LR I just ...
1
vote
1answer
13 views

how to produce documents like factset blackline?

factset blackline reports essentially can compare two 10-Q SEC filings and show you the difference between the two documents. It highlights added items in green and removed items in red + ...
1
vote
0answers
20 views

Python code for Mapping Generated Trigram back to individual rows of Comments [closed]

I have this query regarding NLP Dataset. Please refer it below: Once we generate trigrams from 5000 rows of reviews, say from entire corpus of text, we generated 1000 trigrams, then if we need to map ...
2
votes
0answers
14 views

Sign Language to Speech conversion

Is there any solution about sign language to speech conversion for mobiles? Can anyone suggest me the flow and tools so that I may implement the solution for mobiles?
2
votes
0answers
25 views

Can we use GPT-2 to smooth out / correct text?

Are we able to use models like GPT-2 to smooth out/correct text? For instance if I have two paragraphs that need some text to make the transition easier to read, could this text be generated? And, ...
1
vote
0answers
11 views

Creating a noising model for NLP that models human noising

I'm trying to create a noising model that accurately reflects how people would noise name data. I was thinking of randomly switching out characters and creating a probability over which character gets ...
0
votes
0answers
21 views

Is open source emotion analysis API on text

Textblob is a great open-source tool for sentiment analysis. I want to perform emotion analysis such as joy, happiness, sadness, anger etc on the text. There are multiple paid API or up to certain ...
1
vote
0answers
19 views

How to tell if two hotel reviews addressing the same thing

I am playing with a large dataset of hotel reviews, which contains both positive and negative reviews (the reviews are labeled). I want to use this dataset to perform textual style transfer - given a ...
3
votes
2answers
130 views

What is “Computational Linguistics”?

It's not clear to me whether or not someone whose work aims to improve an NLP system may be called a "Computational Linguist" even when she/he doesn't modify the algorithm directly by coding. Let's ...
2
votes
0answers
48 views

Can Bert be used to extract embedding for large categorical features?

I've lot of training data points (i.e in millions) and I've around few features but the issue with that is all the features are categorical data with 1 million+ categories in each. So, I couldn't use ...
1
vote
2answers
50 views

How much knowledge of the world is learnt through words?

We know a lot of common sense about the world. Things like "to buy something you need money". I wonder how much of this common sense comes about through actual someone explicitly telling you the ...
5
votes
1answer
59 views

Is Sanskrit still relevant for NLP/AI?

I came across a news article from 2018 where the president of India was saying that Sanskrit is the best language for ML/AI. I have no idea regarding his qualification on either AI or Sanskrit to say ...
4
votes
1answer
43 views

Training an RNN to answer simple quesitons

I would like to train an RNN to follow the sentences: "Would you like some cheese"? with "Yes, I would like some cheese." So whenever the template "Would you like some ____?" appears then RNN ...
0
votes
1answer
30 views

Extract product information from email receipt HTML

I am trying to extract product information from email receipts HTML. Most services I have found focus on OCR from paper receipts or PDFs. I would imagine that extraction of product information would ...
2
votes
0answers
33 views

How can I extract the reason of the legal compensation from a court report?

I'm working on a project (court-related). At a certain point, I have to extract the reason of the legal compensation. For instance, let's take these sentences (from a court report) Order mister X ...
4
votes
2answers
64 views

Does summing up word vectors destroy their meaning?

For example, I have a paragraph which I want to classify in a binary manner. But because the inputs have to have a fixed length, I need to ensure that every paragraph is represented by a uniform ...
3
votes
0answers
25 views

Creating an AI than can learn to give instructions

So we think a computer is dumb because it can only follow instructions. Therefor I am trying to create an AI that can give instructions. The idea is this: Create a geometric scene (A) then make a ...
4
votes
2answers
50 views

Is there any classifier that works best in general for NLP based projects?

I've written a program to analyse a given piece of text from a website and make conclusary classifications as to its validity. The code basically vectorizes the description (taken from the HTML of a ...
2
votes
1answer
74 views

How to use AI for language recognition?

Given an audio track, I'm trying to find a way to recognize the audio language. Only within a small set (e.g. English vs Spanish). Is there a simple solution to detect the language in a speech?
2
votes
0answers
73 views

Is NLP likely to be sufficiently solved in the next few years?

The reason I am asking this question is because I am about to start a PhD in NLP. So I am wondering if there would be as much job opportunities in research in industry as oppose to in academia in the ...

1
2 3 4 5
7