Linked Questions
14 questions linked to/from What is self-supervised learning in machine learning?
12
votes
3
answers
11k
views
What is the relation between semi-supervised and self-supervised visual representation learning?
What's the differences between semi-supervised learning and self-supervised visual representation learning, and how they are connected?
- 271
6
votes
1
answer
11k
views
Which tasks are called as downstream tasks?
The following paragraph is from page no 331 of the textbook Natural Language Processing by Jacob Eisenstein. It mentions about certain type of tasks called as downstream tasks. But, it provide no ...
- 3,481
8
votes
3
answers
4k
views
Do GANs come under supervised learning or unsupervised learning?
Do GANs come under supervised learning or unsupervised learning?
My guess is that they come under supervised learning, as we have labeled dataset of images, but I am not sure as there might be other ...
- 107
5
votes
2
answers
962
views
How to understand the concept of self-supervised learning in AI?
I am new to self-supervised learning and it all seems a little magical at the moment.
The only way I can get an intuitive understanding is to assume that, for real-world problems, features are still ...
- 51
3
votes
1
answer
1k
views
How to generate labels for self-supervised training?
I've been reading a lot lately about self-supervised learning and I didn't understand very well how to generate the desired label for a given image.
Let's say that I have an image classification task, ...
- 161
4
votes
1
answer
1k
views
Where do the feature extraction and representation learning differ?
Feature selection is a process of selecting a subset of features that contribute the most.
Feature extraction allows getting new features that are not actually present in the given set of features.
...
- 3,481
0
votes
1
answer
1k
views
What is the purpose of the GAN?
The Generative Adversarial Network (GAN) is composed of a generator $G$ and a discriminator $D$. How do these two components interact? What is the intuition behind the GAN, its purpose, and how it is ...
4
votes
1
answer
295
views
How Does AlphaGo Zero Implement Reinforcement Learning?
AlphaGo Zero (https://deepmind.com/blog/alphago-zero-learning-scratch/) has several key components that contribute to it's success:
A Monte Carlo Tree Search Algorithm that allows it to better search ...
- 511
1
vote
1
answer
543
views
What is the difference between distant supervision and self-supervision?
Weak supervision is supervised learning, with uncertainty in the labeling, e.g. due to automatic labeling or because non-experts labelled the data [1].
Distant supervision [2, 3] is a type of weak ...
- 143
2
votes
1
answer
242
views
Is it possible to pre-train a CNN in a self-supervised way so that it can later be used to solve an instance segmentation task?
I would like to use self-supervised learning (SSL) to learn features from images (the dataset consists of similar images with small differences), then use the resulting trained model to bootstrap an ...
- 21
3
votes
1
answer
257
views
Does self-supervised learning require auxiliary tasks?
Self-supervised learning algorithms provide labels automatically. But, it is not clear what else is required for an algorithm to fall under the category "self-supervised":
Some say, self-...
- 143
4
votes
1
answer
153
views
What is the relation between self-taught learning and transfer learning?
I am new to transfer learning and I start by reading A Survey on Transfer Learning, and it stated the following:
according to different situations of labeled and unlabeled data in the source domain, ...
- 361
2
votes
0
answers
119
views
Does Yann LeCun consider k-means self-supervised learning?
I was discussing the topic of self-supervised learning with a colleague. After a while we realized we were using different definitions. That's never helpful.
Both of us were introduced to self-...
- 121
2
votes
1
answer
86
views
What are some most promising ways to approximate common sense and background knowledge?
I learned from this blog post Self-Supervised Learning: The Dark Matter of Intelligence that
We believe that self-supervised learning (SSL) is one of the most promising ways to build such background ...
- 857