Questions tagged [datasets]
For questions related to sets of data and their use in AI.
12
questions
3
votes
1
answer
2k
views
How to generate labels for self-supervised training?
I've been reading a lot lately about self-supervised learning and I didn't understand very well how to generate the desired label for a given image.
Let's say that I have an image classification task, ...
- 161
3
votes
1
answer
548
views
How to treat (label and process) edge case inputs in machine learning?
In every computer vision project, I struggle with labeling guidelines for border cases. Benchmark datasets don't have this problem, because they are 'cleaned', but in real life unsure cases often ...
- 101
2
votes
1
answer
120
views
Which of the following probability distribution is generating an iid dataset?
Let $X_1, X_2$ be two discrete random variables. Each random variable takes two values: $1, 2$
The probability distribution $p_1$ over $X_1, X_2$ is given by
$$p_1(X_1=1, X_2 = 1) = \dfrac{1}{4}$$
$$...
- 3,581
1
vote
2
answers
318
views
How can we "draw i.i.d" from any probability distribution?
Consider the following paragraph from 2 Learning in High Dimensions in from of the paper titled Geometric Deep Learning Grids, Groups, Graphs, Geodesics, and Gauges
...
- 3,581
5
votes
2
answers
719
views
Why do we need both the validation set and test set?
I know that this has been asked a hundred times before, however, I was not able to find a question (and an answer) which actually answered what I wanted to know, respectively, which explained it in a ...
- 173
4
votes
1
answer
2k
views
Dataset containing images of varying dimensions and orientations
I am new to deep learning.
I have a dataset of images of varying dimensions of a certain object. A few images of the object are also in varying orientations. The objective is to learn the features ...
- 141
3
votes
2
answers
105
views
Are there tools to help labelling images? [closed]
I need to manually classify thousands of pictures into discrete categories, say, where each picture is to be tagged either A, B, or C.
Edit: I want to do this work myself, not outsource / crowdsource ...
- 131
3
votes
1
answer
538
views
Can we use ML to do anything else other than predicting (in the case of mathematical problems)?
(The math problem here just serves as an example, my question is on this type of problems in general).
Given two Schur polynomials, $s_\mu$, $s_\nu$, we know that we can decompose their product into a ...
- 153
3
votes
1
answer
3k
views
What are "proxy data sets" in machine learning?
The paper Assessment of Deep Generative Models for High-Resolution Synthetic Retinal Image Generation of Age-Related Macular Degeneration uses the term "proxy data sets" in this way
To develop DL ...
- 185
1
vote
2
answers
891
views
Why is the validation performance better than the training performance?
I am training a classifier to identify 24 hand signs of American Sign Language. I created a custom dataset by recording videos in different backgrounds for each of the signs and later converted the ...
- 51
1
vote
1
answer
83
views
Is it okay to think of any dataset in artificial intelligence as a mathematical set?
A dataset is a collection of data points. It is known that the data points in the dataset can repeat. And the repetition does matter for building AI models.
So, why does the word dataset contain the ...
- 3,581
1
vote
1
answer
686
views
What is the meaning or implications of the rank of a dataset for machine learning algorithms?
Consider a dataset with $n$ training examples and $d$ features.
Let $D_{n \times d}$ be the data matrix and $r$ be the rank of it.
In matrices, rank $r$ is generally useful in
Knowing the dimension ...
- 3,581