11 votes

What is the difference between self-supervised and unsupervised learning?

In self-supervised learning (SSL) you use your own inputs $x$ (or a modification, e.g. a crop or with data augmentation applied) as the supervision. Instead, in unsupervised learning (UL) there is no ...
Luca Anzalone's user avatar
5 votes

What is the difference between self-supervised and unsupervised learning?

TL;DR While both methods learn from data without human-annotated labels, the primary difference lies in the way they use the data: Self-supervised learning makes use of the structure within the data ...
ofou's user avatar
  • 151
3 votes
Accepted

Reinforcement Learning vs Supervised Learning

Your statements are mostly incorrect, there are very large differences between reinforcement learning (RL) and supervised learning (SL). In SL, you have labels that should be the correct answer that a ...
Dr. Snoopy's user avatar
  • 1,355
1 vote

What technique is used for training Large Language Models like GPT?

since these labels are derived from the input data itself the pre-training phase is considered self-supervised learning, which is a subset of supervised learning, as the name would suggest. Calling ...
Phillip Maire's user avatar
1 vote

What technique is used for training Large Language Models like GPT?

These models are trained with unsupervised learning, but it's probably more intuitive to describe it as self-supervised learning. Your confusion makes sense: the next-token prediction objective, which ...
Alexander Wan's user avatar
1 vote
Accepted

Inquiry on Combining Two Neural Networks for unsupervised training: Has This Been Researched?

Based on my knowledge, there has not been an architecture that covers all the points you have described. Significant development has occurred in creating networks that utilize subnetworks with ...
Cesar Ruiz's user avatar
1 vote

Can we generate labels for an unlabelled dataset by doing some feature engineering?

Whether you can do this is going to depend on what "recurring donor" is supposed to mean. Defining it based on age and number of donations seems pretty sensible to me, but, in the end, it's ...
Alexander Wan's user avatar
1 vote

What is the difference between self-supervised and unsupervised learning?

Self-supervised learning is one approach to unsupervised learning. There are other approaches to unsupervised learning, too. In both cases, we have a dataset of instances with no labels, and we're ...
D.W.'s user avatar
  • 307

Only top scored, non community-wiki answers of a minimum length are eligible