Questions tagged [data-labelling]
For questions related to the problem of labelling data and data labelling techniques in the context of artificial intelligence.
38
questions
0
votes
1
answer
21
views
What papers can I read that explore model performance vs dataset size?
I am trying to estimate how many images I need to label for an object detection task. I understand a lot of variables are at play, but I'd like to find some papers that have already explored this ...
0
votes
0
answers
27
views
How to balance classes for YOLO?
The problem I am having is that to my understanding we need to annotate all objects of all classes on the images we want to train (or fine tune) our YOLO on. This is because YOLO compares labeled ...
- 1,240
0
votes
0
answers
20
views
labelling in supervised market prediction direction problem
I'm quite frustrated about labelling methods in the context of supervised learning for market direction prediction. Let us assume that we would like to use one fancy method of AI to forecast the ...
- 1
0
votes
0
answers
30
views
How do we determine what is correct and what not in Adaboost
In Adaboost, how is it determined what is correct and what not?
In the following example from StatQuest (in youtube), what correct is
and what incorrect makes sense in real life. But what if we have a ...
- 3
0
votes
0
answers
11
views
Is it a good idea to have a category and its subcategories in the training set of an object segmentation model?
I am currently training an object segmentation model (detectron2 : mask rcnn)
The objective is to detect materials like wood, plastic, glass etc...
wood is one of the categories in my training set.
Is ...
2
votes
0
answers
21
views
How to decide which column has more weightage to output
As per Image we can see Column_A value is directly proportional to output,
While Change in value of Column_B has no effects in output.
So basically I want to know is there any algorithm where I can ...
- 21
0
votes
1
answer
32
views
Semi-supervised learning algorithms creating redundant data
If I'm generating pseudo-labels that I'm confident are correct for my dataset due to high confidence scores or something else, how can I expect that the new data I'm labeling won't be redundant? To my ...
- 131
0
votes
0
answers
14
views
If you have a small amount of labeled data and a limitless amount of pseudo-labeled data, does the ratio of labeled to pseudo-labeled data matter?
Suppose I have a labeled dataset $L$ and unlabeled dataset $U$, where $U \gg L$. Suppose I focus on a subset of $U$ called $u$ and generate a subset of $u$ I'll call $u_L$ that consists of ...
- 11
1
vote
1
answer
28
views
possible to combine multiple labeled objects as one object?
So I have labeled the entire skeletal muscles in detail. For example instead of just labeling shoulders I have labeled:
Rear Delt
Middle Delt
Front Delt
but now you want all of the delts to be ...
- 11
1
vote
1
answer
80
views
Using a pre-trained model to generate labels to data to then train a model on
I'm trying to set up a pipeline for my ML models to automatically re-train themselves whenever concept drift occurs to recalibrate to the new output distributions. However, I can't get ground-truth ...
- 11
0
votes
0
answers
13
views
How to determine whether this situation belongs to data leakage or not
Suppose that I use three features (x1, x2, x3) to predict the value of y. After hyperparameters tuning, the r2 score on train/valid/test set is 0.92, 0.54, 0.55 respectively, it's not so good.(It is ...
7
votes
2
answers
770
views
Is there an argument against using the (reviewed) predictions of a model as ground truth to further train exactly this model?
I plan to use my predictions as ground truth to continue training my model. These predictions are of course reviewed during this process. Is there an argument against that (reinforcement of slight ...
- 73
0
votes
0
answers
16
views
Which rule could I use to identify suppliers who are likely to leave us or stay with us?
I have 3 domains of supplier data (Jan 2017 to Jan 2022) and they are as follows
Purchase data - Contains all the purchase (of product) data made by the suppliers with us. It contains columns such ...
- 101
0
votes
0
answers
63
views
When generating segmentation mask, is it better for the ground truth mask to be a bit inside the object than outside?
I got asked this question today, and I was wondering.
When manually annotating images for ground truth, is it better for the model to get segmentation masks that are a bit inside the object or a bit ...
- 101
0
votes
1
answer
73
views
Is there a standard term for the following flaw in the data?
I wonder if following characteristic of data has some standard "professional" or scientific term associated with it.
Let's assume that I have a set of dog/cat images labeled 0 for a cat and ...
- 1,240
1
vote
1
answer
67
views
What techniques exist to increase the learning importance of difficult-to-learn labels over easy ones?
I am training a model to place labels in image data. Some labels are learnt very quickly by the model while others take a long time to perfect. I cannot simply add more labeled data with only the ...
- 11
0
votes
0
answers
28
views
What are the "per image" annotations that are generally used for image datasets in AI?
Computer vision is highly benefited by AI algorithms. Image data is abundantly available. There are different varieties of tasks such as image classification, prediction, segmentation, generation, ...
- 3,491
1
vote
1
answer
224
views
General approaches in text encoding and labelling for NLP [closed]
What are the approaches of encoding text data? I would be glad to hear some summarization from experienced persons.
And are there any solutions accepting words outside the vocabulary and including ...
- 111
2
votes
1
answer
197
views
Best practice for handling letterboxed images for non fully-convolutional deep learning networks?
I'm working on a depth estimation network. It has two outputs:
A relative depth map
A scalar for scaling the relative depth map into an absolute depth map. This second output uses dense layers so ...
- 153
0
votes
1
answer
204
views
How to label unsupervised data for deep learning multi-classification
I have unlabeled credit card transaction data that has the following columns:
...
0
votes
1
answer
78
views
Should I train my network for classification on samples whose ground truth label is ambiguous?
Imagine that I am training a model to classify handwritten digits. Suppose there are some bad quality images that could be classified by a human as either 0 or 8, 1 or 7 or other commonly ...
- 221
0
votes
1
answer
147
views
How to handle an unbalanced dataset when training object detection algorithms?
I am training an object detection model, and I have some very highly unbalanced data annotations. I have almost 11,000 images, all with dimensions of 1024 $\times$ 1024.
Within those images I have the ...
- 129
2
votes
0
answers
109
views
Is soft labeling the same thing as label smoothing?
I have some data with soft labels and I am trying to figure out the best approach to solve the problem with Machine Learning (since regular classification is of the table, i.e. hard labels). However, ...
- 121
0
votes
1
answer
32
views
An online editor that allows data labeling format [closed]
I have a set of students (~20) that will work on annotating data for an NLP project.
The annotation task will be as in the following:
...
- 123
4
votes
1
answer
2k
views
How to add negative samples for object detection?
My question is: how to add certain negative samples to the training dataset to suppress those samples that are recognized as the object.
For example, if I want to train a car detector. All my training ...
- 143
1
vote
0
answers
77
views
How to deal with images that do not contain any object of interest?
I'm currently working on an iOS App where I want to detect if there is a table, chair or bench in the current camera input.
My idea was to take the MobileNetV2 model and get it to classify these three ...
- 11
1
vote
2
answers
3k
views
What is the difference between "ground truth" and "ground-truth labels"?
I'm aware that the ground-truth of the example at the top left-hand corner of the image below is "zero"
However, I am confused about the meaning of the terms ground truth and ground-truth ...
- 211
2
votes
1
answer
95
views
Is intersection of labels acceptable in computer vision?
I have a dataset, where objects are very close to each other. So, the question is: what is the best approach to label them?
There are two possible options:
mark objects so that they will not ...
- 121
3
votes
1
answer
83
views
Is there a methodology for splitting up annotated orthophotos into smaller photos that retain the original bounding boxes?
I'm trying to train an object detection algorithm (i.e. YOLOv4 Scaled, Faster R-CNN) on data taken from large orthophotos. Let's say I have one class, and I label the entire orthophoto with bounding ...
- 129
0
votes
0
answers
54
views
Data Augmentation of store images using handwritten labels
I am new to AI and NN. I've started learning using Geron's book on Tensorflow.
My first project ("Smart Shelf") is to determine which items in a store have been purchased and need refilled. ...
2
votes
0
answers
28
views
For binary classification learning problems, how should I label instances where I'm only 60% sure?
I've come across a few binary classification problems lately where the labelling was challenging even for an expert. I'm wondering what I should do with this. Here are some of my suggestions to get ...
- 1,259
5
votes
1
answer
76
views
Do models train better if the labelling information is more specific (or dense)?
I'm working on a project where there is a limited dataset of videos (about 200). We want to train a model that can detect a single class in the videos. That class can be of multiple different types of ...
- 153
10
votes
1
answer
296
views
How to deal with a small amount of labeled samples?
I'm trying to develop skills to deal with very small amounts of labeled samples (250 labeled/20000 total, 200 features) by practicing on Kaggle "Don't Overfit" dataset (Traget_Practice have ...
- 201
2
votes
1
answer
502
views
How to detect multiple playing cards of the same class with a neural network?
I want to train an AI to detect the class (i.e. suit and rank) of playing cards. Playing cards from different decks may use slightly different shapes or colors to represent these attributes, and I ...
- 121
1
vote
2
answers
522
views
How do I change the annotations of variable-size images after having resized the images to a fixed size?
In the data-sets like coco-text and total-text, the images are of different sizes (height*width). I'm using these data sets for text detection. I want to create a DNN model for this. So the input data ...
- 43
3
votes
1
answer
89
views
How can computers beat humans at image recognition, if humans may incorrectly label the images?
For supervised learning, humans have to label the images computers use to train in the first place, so the computers will probably get wrong the images that humans get wrong. If so can computers beat ...
- 191
2
votes
1
answer
2k
views
How to label edited images after data augmentation?
I am new to neural networks, I've only started studying and learning about the subject a year ago, and I just started building my first neural network.
The project is a little bit ambitious: A browser ...
- 176
5
votes
2
answers
1k
views
What is the effect of mislabeled training data?
Collecting and labeling training data for supervised learning tasks is incredibly time-consuming and costly.
For instance, let's say you wrote a script that went on Google images and got you 5000 ...
- 474