14 questions linked to/from What is self-supervised learning in machine learning?
What is the relation between semi-supervised and self-supervised visual representation learning?
What's the differences between semi-supervised learning and self-supervised visual representation learning, and how they are connected?
Which tasks are called as downstream tasks?
The following paragraph is from page no 331 of the textbook Natural Language Processing by Jacob Eisenstein. It mentions about certain type of tasks called as downstream tasks. But, it provide no ...
Do GANs come under supervised learning or unsupervised learning?
Do GANs come under supervised learning or unsupervised learning? My guess is that they come under supervised learning, as we have labeled dataset of images, but I am not sure as there might be other ...
How to understand the concept of self-supervised learning in AI?
I am new to self-supervised learning and it all seems a little magical at the moment. The only way I can get an intuitive understanding is to assume that, for real-world problems, features are still ...
How to generate labels for self-supervised training?
I've been reading a lot lately about self-supervised learning and I didn't understand very well how to generate the desired label for a given image. Let's say that I have an image classification task, ...
Where do the feature extraction and representation learning differ?
Feature selection is a process of selecting a subset of features that contribute the most. Feature extraction allows getting new features that are not actually present in the given set of features. ...
What is the purpose of the GAN?
The Generative Adversarial Network (GAN) is composed of a generator $G$ and a discriminator $D$. How do these two components interact? What is the intuition behind the GAN, its purpose, and how it is ...
How Does AlphaGo Zero Implement Reinforcement Learning?
AlphaGo Zero (https://deepmind.com/blog/alphago-zero-learning-scratch/) has several key components that contribute to it's success: A Monte Carlo Tree Search Algorithm that allows it to better search ...
What is the difference between distant supervision and self-supervision?
Weak supervision is supervised learning, with uncertainty in the labeling, e.g. due to automatic labeling or because non-experts labelled the data . Distant supervision [2, 3] is a type of weak ...
Is it possible to pre-train a CNN in a self-supervised way so that it can later be used to solve an instance segmentation task?
I would like to use self-supervised learning (SSL) to learn features from images (the dataset consists of similar images with small differences), then use the resulting trained model to bootstrap an ...
Does self-supervised learning require auxiliary tasks?
Self-supervised learning algorithms provide labels automatically. But, it is not clear what else is required for an algorithm to fall under the category "self-supervised": Some say, self-...
What is the relation between self-taught learning and transfer learning?
I am new to transfer learning and I start by reading A Survey on Transfer Learning, and it stated the following: according to different situations of labeled and unlabeled data in the source domain, ...
Does Yann LeCun consider k-means self-supervised learning?
I was discussing the topic of self-supervised learning with a colleague. After a while we realized we were using different definitions. That's never helpful. Both of us were introduced to self-...
What are some most promising ways to approximate common sense and background knowledge?
I learned from this blog post Self-Supervised Learning: The Dark Matter of Intelligence that We believe that self-supervised learning (SSL) is one of the most promising ways to build such background ...