Questions tagged [text-classification]

For questions about text classification, the task of assigning predefined categories (or classes) to free-text documents.

Filter by
Sorted by
Tagged with
0 votes
0 answers
24 views

Increasing "output_sequence_length" in TextVectorization layer worsens model's performance

When exploring the Twitter Sentiment Analysis dataset on Kaggle, I came up with a model that looks like this: ...
0 votes
0 answers
15 views

Text Classification Model unable to learn

I am trying to build a text classification model. When I train the model it is unable to improve accuracy and at some point accuracy even decreases and loss increases. I have researched for possible ...
1 vote
0 answers
17 views

Giving Specified Data a Larger Value/Weight in a Model

I'm in the process of creating a model to classify an occupational code based on a job title & description. I have a large sample of labelled data to achieve this. The government has a resource ...
0 votes
1 answer
21 views

Pre-Trained Model for Occupational Coding

I've recently embarked on a task to classify an occupation code, given a job title & description. I have come across clustering, a method of grouping data into clusters of which were not ...
0 votes
1 answer
57 views

Multilabel text classification with highly imbalanced training data

I'm trying to train a multilabel text classification model using BERT. Each piece of text can belong to 0 or more of a total of 485 classes. My model consists of a dropout layer and a linear layer ...
0 votes
1 answer
70 views

How do I use ResNet for text processing?

I need to implement a deep neural network [residual neural network (ResNet)] that takes some text as an input [length M x N] and then processes it. Now as far as my understanding goes, ResNet is used ...
  • 1
-1 votes
2 answers
77 views

How do I generate video classification labels using video descriptions/titles?

I've been scanning the internet for ways to generate baseball-based labels for youtube baseball videos using text collected from a YT video's description, title, and top 50 titles, but so far, I have ...
0 votes
0 answers
9 views

How to perform domain adaptation if there are only unlabelled data in both source and target domains

Recently I am reading literature regarding domain adaption. However, most of the works consider scenarios when there are some labelled data in the source domain. So I wonder if there is any ...
0 votes
0 answers
19 views

NLP - F1 score for positive class drops to 0 after data augmentation

I'm working on a 3-class text classification problem where my initial class distribution looked like this: positive: 50% negative: 25% and neutral: 25% And training on a model on this slightly ...
0 votes
0 answers
81 views

Classify/categorize parts of text with machine learning (Python)

I need to parse some documents (which consists of questions, answers, transition messages and other texts) into a structured format. Here is an example of input document (part of it): I have to ...
  • 1
0 votes
0 answers
39 views

Turn 3D Embedding into 2D for classification in PyTorch

I am building a pytorch transformer model that shall perform text classification I have a batch size B, a sequence length T, and an embedding size D So first my input (B, T) is passed into an ...
1 vote
1 answer
86 views

How to predict the rating of a text review and improve it?

Why is it better to treat the rating prediction of a text review as a regression problem rather than a classification one? Is it because the ratings (1,2,3,4,5) are ordinal variables? What kind of ...
  • 195
1 vote
1 answer
80 views

Using a pre-trained model to generate labels to data to then train a model on

I'm trying to set up a pipeline for my ML models to automatically re-train themselves whenever concept drift occurs to recalibrate to the new output distributions. However, I can't get ground-truth ...
0 votes
0 answers
46 views

How to remove boilerplate (or extract main content) from web pages?

Data: Raw source code of a website and the final cleaned main content I want to extract from the raw source code. The source code comes from different websites with different layouts and code ...
0 votes
0 answers
34 views

How to add pretrained vectorizer and classification model to onnx pipeline for NLP task?

I have trained Logistic regression model for documents classification. I have saved the fit tfidf vectorizer and the model as well. Also, I have created a custom DataCleaner class which inherits ...
  • 101
0 votes
0 answers
25 views

Clustering similar words with pre-defined clusters

I parse many text messages daily that contain product names. My parser has pre-defined products that it looks for, however I would like to automatically cluster all new products in new clusters but ...
  • 103
0 votes
1 answer
34 views

Distinguishing text with opposite meanings in SVM (False Information Detection)

I am currently working on a Binary Text Classification Model (False Information Detection) using Support Vector Machine and used TF-IDF as text vectorizer in Python. I have already tried training the ...
1 vote
1 answer
196 views

Which pre-processing steps are necessary for Deep Learning models to solve a document classification problem?

I have created a data set with 30.000 text documents (each text file is rather small with respect to its length), which are labelled with 0 and 1. Using this data set, I want to train machine learning ...
0 votes
0 answers
23 views

Which AI algorithm to use for identifying API for a specific use from a list of APIs?

We have a legacy code solution in C#. We have to change the code so that it fetches internal data via APIs and not via DB calls. E.g. if the current code GETS Payment object from DB, we have to ...
  • 1
0 votes
1 answer
432 views

Get the name of a merchant from records

I have a bunch of bank transaction records from which I want to extract merchants' names. In a few subsets of these records, the structure of the string is the same within the subset with only the ...
0 votes
1 answer
143 views

Training and Evaluating BERT and XLNET [closed]

I am thinking about a project and have a few questions before I accept it. Would be grateful I anyone experienced of you could give me some advice. In the project, I have been given a data set with (...
0 votes
0 answers
35 views

How to calculate cosine similarity for classification when you have say 10000 samples belonging to two classes have a bunch of samples

Does anyone have experience with using Cosine Similarity for text classification? I see a number of articles on how to find cosine similarity between documents using Doc2Vec, Gensim, etc. I have a ...
1 vote
1 answer
942 views

Is there an AI that can extract proper nouns from free text?

I have some free text (think: blog articles, interview transcripts, chat comments), and would like to explore the text data by analysing the proper nouns it contains. I know of many ways to simply ...
  • 111
0 votes
1 answer
109 views

Advantages of CNN vs. LSTM for sequence data like text or log-files

When do you tend to use CNN rather than LSTM (or the other way round) in classification or generation tasks of sequential data like text or log-data? What are the reasons for the decision and what ...
0 votes
1 answer
62 views

Which algorithm can be used for extracting text patterns in tabular data?

I am working with tabular data that is similar to the below: Name Phone Number ISO3 Country Amount Email ... ... Outcome Possible Reason Leona Sunfurry (555)-555-5555 United States 58.96 leo_sun@...
0 votes
1 answer
100 views

What approach to use for selecting one of the category according to short category text?

I need some tool to classify articles based on short category text which consists of two or three words separated by '-'. The RSS/XML tag content is for example: Foreign - News Football - Foreign I ...
  • 5
1 vote
1 answer
174 views

Multi class text classification when having only one sample for classes

I have a dataset of texts, each text was identified with an ID number. I would like to do a prediction by finding the best match ID number for upcoming new texts. To use multi text classification, I ...
  • 11
2 votes
1 answer
580 views

How to go about classifying 1000 classes?

I am trying to find research paper with theory(preferably implementation) that is about classifying 1000 (or more) classes. I have heard of an implementation, that initially clustering needs to be ...
1 vote
0 answers
475 views

Is using a LSTM, CNN or any other neural network model on top of a Transformer(using hidden states) overkill?

I have recently come across transformers, I am new to Deep Learning. I have seen a paper using CNN and BiLSTM on top of a transformer, the paper uses a transformer(XLM-R) for sentiment analysis in ...
  • 11
1 vote
0 answers
21 views

Bechmark models for Text Classification / Sentiment Classification

I am currently working on a novel application in NLP where I try to classify empathic and non-empathic texts. I would like to compare the performance of my model to some benchmark models. As I am ...
  • 11
2 votes
0 answers
110 views

NLP Bible verse division problem: Whats the best model/method?

I'm working on a project compiling various versions of the Bible into a dataset. For the most part versions separate verses discreetly. In some versions, however, verses are combined. Instead of verse ...
  • 121
1 vote
1 answer
490 views

Can I use one-hot vectors for text classification?

For an upcoming project I'm trying to write a text classifier for the IMDb sentiment analysis dataset. This needs to vectorize words using an embedding layer and then reduce the dimensions of the ...
2 votes
1 answer
93 views

How do RNN's for sentiment classification deal with different sentence lengths?

I have been doing a course which teaches you about Deep Neural Networks, during one of the exercises I was made to make an RNN for sentiment classification which I did, but I did not understand how an ...
1 vote
2 answers
287 views

Is it possible that every class has a higher recall than precision for multi-class classification?

I am a student learning machine learning recently, and one thing is keep confusing me, I tried multiple sources and failed to find the related answer. As following table shows (this is from some paper)...
0 votes
1 answer
59 views

Text classification of non-equal length texts, should I pad left or right?

Text classification of equal length texts works without padding, but in reality, practically, texts never have the same length. For example, spam filtering on blog article: ...
  • 1,283
0 votes
1 answer
678 views

NLP Identifying important key words in a corpus

I am intrigued with the idea of Zettelkasten but unsatisfied with the current implementations. It seems to me that a machine learning and NLP approach could be productive by helpfully identifying “...
1 vote
0 answers
38 views

My LSTM text classification model seems not learn anything in early epochs

I am trying to use LSTM to do text classification and monitor the training process with tensorboard. But it seems that this model doesn't learn anything in early epochs. Is it normal for LSTM networks?...
  • 11
1 vote
0 answers
118 views

Applications of polar decomposition in Machine Learning

Assume there exists a new and very efficient algorithm for calculating the polar decomposition of a matrix $A=UP$, where $U$ is a unitary matrix and $P$ is a positive-semidefinite Hermitian matrix. ...
  • 11
1 vote
0 answers
44 views

How many spectrogram frames per input character does text-to-speech (TTS) system Tacotron-2 generate?

I've been reading on Tacotron-2, a text-to-speech system, that generates speech just-like humans (indistinguishable from humans) using the GitHub https://github.com/Rayhane-mamah/Tacotron-2. I'm very ...
  • 171
1 vote
0 answers
55 views

Creating Text Features using word2vec

My task is to classify some texts. I have used word2vec to represent text words and I pass them to an LSTM as input. Taking into account that texts do not contain the same number of words, is it a ...
  • 909
3 votes
4 answers
104 views

Top Frequent occurrence word effect in Model Efficiency?

Assume that I have a Dataframe with the text column. Problem: Classification / Prediction ...
  • 1,223
1 vote
1 answer
49 views

Can artificial intelligence classify textual records?

I am a records manager and I am being asked if I recommend Office 365. I'm having a hard time making a recommendation because I am missing an essential piece of information: can Office 365 replace ...
  • 111
2 votes
0 answers
61 views

Are bayesian neural networks suited for text (or document) classification?

I've tried to do my research on Bayesian neural networks online, but I find most of them are used for image classification. This is probably due to the nature of Bayesian neural networks, which may be ...
  • 21
1 vote
1 answer
93 views

Is it possible to derive meaning from text by providing multiple ways of saying the same thing to a neural network?

Let's say I feed a neural network with multiple string sentences that mean roughly the same thing but are formulated differently. Will the neural network be able to derive patterns of meaning in the ...
2 votes
0 answers
27 views

Language Learning feedback with AI

Is there a program under development that uses AI technology, like Siri, to "hold hands" so to speak with a language learner and coach them on accent, colloqiual expressions, or to let them guide the ...
3 votes
1 answer
77 views

When is it time to switch to deep neural networks from simple networks in text classification problems?

I did an out of domain detection task (as a binary classification problem) and tried LR and Naive Bayes and BERT but the deep neural network didn't perform better than LR and NB. For the LR I just ...
1 vote
0 answers
46 views

Text detection on English and Chinese language

https://arxiv.org/abs/1910.07954 In this paper, we have a convolutional character neural network where we have object detection by taking a character as a basic unit. First, we do character detection ...
2 votes
1 answer
196 views

How does the weight update formula for logistic regression work?

I am trying to use Logistic Regression to make a spam filter, but I am having trouble understanding the weight update part. I have processed my email dataset, and I have an attribute vector of the top ...
  • 31
4 votes
2 answers
126 views

Does summing up word vectors destroy their meaning?

For example, I have a paragraph that I want to classify in a binary manner. But because the inputs have to have a fixed length, I need to ensure that every paragraph is represented by a uniform ...
  • 101
3 votes
1 answer
69 views

How can a system recognize if two strings have the same or similar meaning?

How can a system recognize if two strings have the same or similar meaning? For example, consider the following two strings Wikipedia provides good information. Wikipedia is a good source of ...