# Questions tagged [datasets]

For questions related to sets of data and their use in AI.

12 questions
Filter by
Sorted by
Tagged with
2k views

### How to generate labels for self-supervised training?

I've been reading a lot lately about self-supervised learning and I didn't understand very well how to generate the desired label for a given image. Let's say that I have an image classification task, ...
548 views

### How to treat (label and process) edge case inputs in machine learning?

In every computer vision project, I struggle with labeling guidelines for border cases. Benchmark datasets don't have this problem, because they are 'cleaned', but in real life unsure cases often ...
120 views

### Which of the following probability distribution is generating an iid dataset?

Let $X_1, X_2$ be two discrete random variables. Each random variable takes two values: $1, 2$ The probability distribution $p_1$ over $X_1, X_2$ is given by $$p_1(X_1=1, X_2 = 1) = \dfrac{1}{4}$$ ...
1 vote
318 views

### How can we "draw i.i.d" from any probability distribution?

Consider the following paragraph from 2 Learning in High Dimensions in from of the paper titled Geometric Deep Learning Grids, Groups, Graphs, Geodesics, and Gauges ...
719 views

### Why do we need both the validation set and test set?

I know that this has been asked a hundred times before, however, I was not able to find a question (and an answer) which actually answered what I wanted to know, respectively, which explained it in a ...
2k views

### Dataset containing images of varying dimensions and orientations

I am new to deep learning. I have a dataset of images of varying dimensions of a certain object. A few images of the object are also in varying orientations. The objective is to learn the features ...
105 views

### Are there tools to help labelling images? [closed]

I need to manually classify thousands of pictures into discrete categories, say, where each picture is to be tagged either A, B, or C. Edit: I want to do this work myself, not outsource / crowdsource ...
538 views

### Can we use ML to do anything else other than predicting (in the case of mathematical problems)?

(The math problem here just serves as an example, my question is on this type of problems in general). Given two Schur polynomials, $s_\mu$, $s_\nu$, we know that we can decompose their product into a ...
3k views

### What are "proxy data sets" in machine learning?

The paper Assessment of Deep Generative Models for High-Resolution Synthetic Retinal Image Generation of Age-Related Macular Degeneration uses the term "proxy data sets" in this way To develop DL ...
1 vote
891 views

### Why is the validation performance better than the training performance?

I am training a classifier to identify 24 hand signs of American Sign Language. I created a custom dataset by recording videos in different backgrounds for each of the signs and later converted the ...
1 vote
Consider a dataset with $n$ training examples and $d$ features. Let $D_{n \times d}$ be the data matrix and $r$ be the rank of it. In matrices, rank $r$ is generally useful in Knowing the dimension ...