2022 Developer Survey is open! Take survey.

Questions tagged [imbalanced-datasets]

For questions that involve imbalanced (or unbalanced) datasets.

Filter by
Sorted by
Tagged with
0 votes
3 answers
77 views

How to deal with an unbalanced dataset?

I'm constructing a feed forward neural network that predicts whether a patient will get a stroke or not. However, my dataset is very unbalanced. Out of 5111 rows, 250 contain patients that have had a ...
user avatar
0 votes
2 answers
31 views

How to deal with datasets which are not balanced?

I have a dataset that I want to use for training. The output of the model is a binary value (0,1) The dataset is not balanced, it has only 200 entries for output 1 and 4000 entries for output 0. When ...
user avatar
  • 109
0 votes
0 answers
19 views

What's the best way to train data with unbalanced targets?

Suppose I have data I want to use for supervised learning, but there is a pretty bad target/class/labels imbalance. Should I: Limit the size of the training set to make sure there is a flat target/...
user avatar
  • 131
0 votes
1 answer
31 views

How to arrange test dataset distribution for an imbalanced classification problem?

I have a dataset that contains 560 datapoints, and I would like to do binary classification on it. 400 datapoints belong to class 1, and 160 points belong to class 2. In the case of an imbalanced ...
user avatar
  • 11
2 votes
1 answer
61 views

How do you handle unbalanced image datasets?

I have an image data set on which I am training a CNN. The data set is slightly unbalanced. So, my solution up till now was to delete some images of the majority class. But I now realize that there ...
user avatar
0 votes
1 answer
59 views

How to handle an unbalanced dataset when training object detection algorithms?

I am training an object detection model, and I have some very highly unbalanced data annotations. I have almost 11,000 images, all with dimensions of 1024 $\times$ 1024. Within those images I have the ...
user avatar
  • 119
0 votes
0 answers
26 views

How to deal with unbalanced data in multilabel classification problem

I have 3 possible solutions, but I am not sure if they are good. I think they are a bit clunky (especially 1st and 2nd). Use multiple small models. So instead of having the model that can tell you ...
user avatar
  • 173
0 votes
0 answers
5 views

Evaluating a CNN -multi class model with two separate thresholds

I have a model that outputs three classes. But here instead of one threshold, it depends on a combination of two (user input threshold). One threshold varies from 0.1 to 1.0 and the other varies from ...
user avatar
0 votes
0 answers
9 views

Evaluating a convolutional neural network on an imbalanced (academic) dataset

I have trained a posture analysis network to classify in a video of humans recorded in public places if there is a) shake-hand between two humans, b) Standing close together that their hands touch ...
user avatar
2 votes
1 answer
53 views

How to handle class imbalance when the actual data are that way

My supervised learning training data are obtained from actual data; and in real cases, there's one class that happens less often than other classes, just around 5% of all cases. To be precise, the ...
user avatar
  • 1,143
1 vote
1 answer
61 views

Handling imbalanced data with multiple targets

I have the model which has 3 outputs (it is a regression task, I have the angle of the steering wheel, brake and acceleration). I can divide my values to some smaller bins and in this way I can change ...
user avatar
  • 173
1 vote
1 answer
72 views

Multi class text classification when having only one sample for classes

I have a dataset of texts, each text was identified with an ID number. I would like to do a prediction by finding the best match ID number for upcoming new texts. To use multi text classification, I ...
user avatar
  • 11
0 votes
1 answer
43 views

What does "adding class weights for an imbalanced dataset" mean in the case of multi-label classification?

Suppose I have the following toy data set: Each instance has multiple labels at a time. You can see I have 2 instances for Label2. However, only one instance for the other labels. It means that we ...
user avatar
3 votes
1 answer
81 views

How do I select the (number of) negative cases, if I'm given a set of positive cases?

We were given a list of labeled data (around 100) of known positive cases, i.e. people that have a certain disease, i.e. all these people are labeled with the same class (disease). We also have a much ...
user avatar
  • 33
2 votes
1 answer
170 views

How robust are deep networks to class imbalance?

Before deep learning, I worked with machine learning problems where the data had a large class imbalance (30:1 or worse ratios). At that time, all the classifiers struggled, even after under-sampling ...
user avatar
  • 1,210
2 votes
1 answer
81 views

How to perform binary classification when one class is more predominant than the other?

Assuming we have big $m \times n$ input dataset, with $m \times 1$ output vector. It's a classification problem with only two possible values: either $1$ or $0$. Now, the problem is that almost all ...
user avatar
  • 21
1 vote
1 answer
146 views

Is it possible to combine k-fold cross-validation and oversampling for a multi-class text classification task with imbalanced data?

I am dealing with an intent classification task on an Italian customer service data set. I've more or less 1.5k sentences and 29 classes (imbalanced). According to the literature, a good choice is to ...
user avatar
  • 65
2 votes
1 answer
107 views

How can I use Generative Adversarial Networks to solve the imbalanced class problem?

Problem setting We have to do a binary classification of data given a training dataset $D$, where most items belong to class $A$ and some items belong to class $B$, so the classes are heavily ...
user avatar
7 votes
2 answers
3k views

Does data skew matter in classification problem?

I'm working on an image classification problem using a neural network. In the training data set, 90% of the samples fall into 10% of all categories, while 10% of the sample fall into the other 90% ...
user avatar
  • 173