Questions tagged [text-classification]

For questions about text classification, the task of assigning predefined categories (or classes) to free-text documents.

Filter by
Sorted by
Tagged with
0
votes
1answer
45 views

Get the name of a merchant from records

I have a bunch of bank transaction records from which I want to extract merchants' names. In a few subsets of these records, the structure of the string is the same within the subset with only the ...
1
vote
1answer
29 views

Training and Evaluating BERT and XLNET

I am thinking about a project and have a few questions before I accept it. Would be grateful I anyone experienced of you could give me some advice. In the project, I have been given a data set with (...
0
votes
0answers
32 views

How to calculate cosine similarity for classification when you have say 10000 samples belonging to two classes have a bunch of samples

Does anyone have experience with using Cosine Similarity for text classification? I see a number of articles on how to find cosine similarity between documents using Doc2Vec, Gensim, etc. I have a ...
0
votes
0answers
14 views

Is it possible to identify multiple queries/intents in an email, check if the reply has addressed all of those queries before sending email?

An email may contain multiple questions related to similar or distinct topics. The person responding the email needs assistance in detecting and informing if all of the questions have been addressed ...
0
votes
0answers
12 views

ML model to predict values from text (a lot of training training data)

I have around 1M entries of the type: id | big5_openness | big5_conscientiousness | big5_extraversion | big5_agreeableness | big5_neuroticism | input_text Where <...
1
vote
1answer
342 views

Is there an AI that can extract proper nouns from free text?

I have some free text (think: blog articles, interview transcripts, chat comments), and would like to explore the text data by analysing the proper nouns it contains. I know of many ways to simply ...
0
votes
1answer
45 views

Advantages of CNN vs. LSTM for sequence data like text or log-files

When do you tend to use CNN rather than LSTM (or the other way round) in classification or generation tasks of sequential data like text or log-data? What are the reasons for the decision and what ...
0
votes
1answer
27 views

Which algorithm can be used for extracting text patterns in tabular data?

I am working with tabular data that is similar to the below: Name Phone Number ISO3 Country Amount Email ... ... Outcome Possible Reason Leona Sunfurry (555)-555-5555 United States 58.96 leo_sun@...
0
votes
1answer
32 views

What approach to use for selecting one of the category according to short category text?

I need some tool to classify articles based on short category text which consists of two or three words separated by '-'. The RSS/XML tag content is for example: Foreign - News Football - Foreign I ...
1
vote
1answer
39 views

Multi class text classification when having only one sample for classes

I have a dataset of texts, each text was identified with an ID number. I would like to do a prediction by finding the best match ID number for upcoming new texts. To use multi text classification, I ...
1
vote
1answer
46 views

How to go about classifying 1000 classes?

I am trying to find research paper with theory(preferably implementation) that is about classifying 1000 (or more) classes. I have heard of an implementation, that initially clustering needs to be ...
0
votes
0answers
97 views

Is using a LSTM, CNN or any other neural network model on top of a Transformer(using hidden states) overkill?

I have recently come across transformers, I am new to Deep Learning. I have seen a paper using CNN and BiLSTM on top of a transformer, the paper uses a transformer(XLM-R) for sentiment analysis in ...
0
votes
0answers
25 views

Python: Recognize actions / keywords in natural text?

This is for a personal project, and I am no very skilled programmer, language is Python, needs to work offline. That said: I have a list of 200 key actions, eg. 'Building sandcastles', 'Paintball' or '...
0
votes
0answers
13 views

How can I classify text documents arriving as a stream

To create a classifier for a fixed corpus of texts is straightforward. Take all the documents, form the tfidf matrix and from that matrix take a subset that is tagged accordingly. The classifier built ...
0
votes
0answers
11 views

How to make specific test data prediction with fitted GaussianNB Classifier in Python

I'm trying to make news classification. Here is the neural network: ...
0
votes
0answers
19 views

Python Create Keras Neural Network with Bag Of Words Model for News Classification

I want to train a classification neural network then predict some inputs. It's classic classification example as you know. I'm implementing this with python. I searched a lot about it and I always ...
0
votes
0answers
23 views

What is the best way to do classification using both text and numerical data?

For my BSc thesis I am trying to classify asset price direction (up/down/neutral) using numerical features and Swedish text. The text is short financial news (ca 50 words each) that have sentiment ...
1
vote
0answers
17 views

Bechmark models for Text Classification / Sentiment Classification

I am currently working on a novel application in NLP where I try to classify empathic and non-empathic texts. I would like to compare the performance of my model to some benchmark models. As I am ...
2
votes
0answers
65 views

NLP Bible verse division problem: Whats the best model/method?

I'm working on a project compiling various versions of the Bible into a dataset. For the most part versions separate verses discreetly. In some versions, however, verses are combined. Instead of verse ...
1
vote
1answer
250 views

Can I use one-hot vectors for text classification?

For an upcoming project I'm trying to write a text classifier for the IMDb sentiment analysis dataset. This needs to vectorize words using an embedding layer and then reduce the dimensions of the ...
2
votes
1answer
51 views

How do RNN's for sentiment classification deal with different sentence lengths?

I have been doing a course which teaches you about Deep Neural Networks, during one of the exercises I was made to make an RNN for sentiment classification which I did, but I did not understand how an ...
1
vote
2answers
134 views

Is it possible that every class has a higher recall than precision for multi-class classification?

I am a student learning machine learning recently, and one thing is keep confusing me, I tried multiple sources and failed to find the related answer. As following table shows (this is from some paper)...
0
votes
1answer
42 views

Text classification of non-equal length texts, should I pad left or right?

Text classification of equal length texts works without padding, but in reality, practically, texts never have the same length. For example, spam filtering on blog article: ...
0
votes
1answer
118 views

NLP Identifying important key words in a corpus

I am intrigued with the idea of Zettelkasten but unsatisfied with the current implementations. It seems to me that a machine learning and NLP approach could be productive by helpfully identifying “...
1
vote
0answers
32 views

My LSTM text classification model seems not learn anything in early epochs

I am trying to use LSTM to do text classification and monitor the training process with tensorboard. But it seems that this model doesn't learn anything in early epochs. Is it normal for LSTM networks?...
1
vote
0answers
78 views

Applications of polar decomposition in Machine Learning

Assume there exists a new and very efficient algorithm for calculating the polar decomposition of a matrix $A=UP$, where $U$ is a unitary matrix and $P$ is a positive-semidefinite Hermitian matrix. ...
1
vote
0answers
26 views

How many spectrogram frames per input character does text-to-speech (TTS) system Tacotron-2 generate?

I've been reading on Tacotron-2, a text-to-speech system, that generates speech just-like humans (indistinguishable from humans) using the GitHub https://github.com/Rayhane-mamah/Tacotron-2. I'm very ...
1
vote
0answers
45 views

Creating Text Features using word2vec

My task is to classify some texts. I have used word2vec to represent text words and I pass them to an LSTM as input. Taking into account that texts do not contain the same number of words, is it a ...
3
votes
4answers
95 views

Top Frequent occurrence word effect in Model Efficiency?

Assume that I have a Dataframe with the text column. Problem: Classification / Prediction ...
1
vote
1answer
46 views

Can artificial intelligence classify textual records?

I am a records manager and I am being asked if I recommend Office 365. I'm having a hard time making a recommendation because I am missing an essential piece of information: can Office 365 replace ...
1
vote
0answers
42 views

Are bayesian neural networks suited for text (or document) classification?

I've tried to do my research on Bayesian neural networks online, but I find most of them are used for image classification. This is probably due to the nature of Bayesian neural networks, which may be ...
2
votes
0answers
94 views

Pre-trained Models for Topic Modelling Transfer Learning (LDA) [closed]

I've been searching online - and so far, I've been unable to find any publicly-accessible pre-trained models that can be used for LDA Topic Modeling - Transfer Learning. Can anyone share any resources ...
1
vote
0answers
37 views

Tensorflow based implementation of Text classification with any variation of BERT(ALBERT/XLNET)

Do you have any reference you can point me to for doing Text classification using any variation of BERT(albert or XLnet) with a TF implementation. I am not sure how to deploy torch based models, so ...
1
vote
1answer
51 views

Is it possible to derive meaning from text by providing multiple ways of saying the same thing to a neural network?

Let's say I feed a neural network with multiple string sentences that mean roughly the same thing but are formulated differently. Will the neural network be able to derive patterns of meaning in the ...
2
votes
0answers
19 views

Language Learning feedback with AI

Is there a program under development that uses AI technology, like Siri, to "hold hands" so to speak with a language learner and coach them on accent, colloqiual expressions, or to let them guide the ...
2
votes
1answer
60 views

When is it time to switch to deep neural networks from simple networks in text classification problems?

I did an out of domain detection task (as a binary classification problem) and tried LR and Naive Bayes and BERT but the deep neural network didn't perform better than LR and NB. For the LR I just ...
1
vote
0answers
24 views

Text detection on English and Chinese language

https://arxiv.org/abs/1910.07954 In this paper, we have a convolutional character neural network where we have object detection by taking a character as a basic unit. First, we do character detection ...
2
votes
1answer
65 views

How does the weight update formula for logistic regression work?

I am trying to use Logistic Regression to make a spam filter, but I am having trouble understanding the weight update part. I have processed my email dataset, and I have an attribute vector of the top ...
4
votes
2answers
92 views

Does summing up word vectors destroy their meaning?

For example, I have a paragraph that I want to classify in a binary manner. But because the inputs have to have a fixed length, I need to ensure that every paragraph is represented by a uniform ...
2
votes
1answer
31 views

How can a system recognize if two strings have the same or similar meaning?

How can a system recognize if two strings have the same or similar meaning? For example, consider the following two strings Wikipedia provides good information. Wikipedia is a good source of ...
4
votes
2answers
71 views

Is there any classifier that works best in general for NLP based projects?

I've written a program to analyse a given piece of text from a website and make conclusary classifications as to its validity. The code basically vectorizes the description (taken from the HTML of a ...
3
votes
2answers
291 views

How to use LSTM to generate a paragraph

A LSTM model can be trained to generate text sequences by feeding the first word. After feeding the first word, the model will generate a sequence of words (a sentence). Feed the first word to get the ...
1
vote
1answer
4k views

What is the most accurate pretrained sentiment analysis model by 2019?

I've been using OpenAI's 2017 Sentiment Neuron implementation (https://github.com/openai/generating-reviews-discovering-sentiment) for a while, because it was easy to set up and was the most accurate ...
0
votes
0answers
72 views

How to train LSTM score prediction with very little data? (Bounty to be added)

I am trying to make a text score prediction network, and my dataset have 500 samples only. I know there is a public dataset called the ASAP Dataset. I have tested my model ...
2
votes
1answer
218 views

Is a dataset of roughly 700 sentences of an average length of 15 words enough for text classification?

I'm building a customer assistant chatbot in Python. So, I am modelling this problem as a text classification task. I have available more or less 7 hundred sentences of an average length of 15 words (...
7
votes
2answers
156 views

Why are documents kept separated when training a text classifier?

Most of the literature considers text classification as the classification of documents. When using the bag-of-words and Bayesian classification, they usually use the statistic TF-IDF, where TF ...
2
votes
2answers
6k views

Is there a Python implementation of a deep learning algorithm for text classification?

I am looking for a complete Python implementation of a deep learning algorithm for text classification. I have seen tens of tutorials and they mostly focus on the model and its performance, but I have ...