New answers tagged

1 vote

What technique is used for training Large Language Models like GPT?

since these labels are derived from the input data itself the pre-training phase is considered self-supervised learning, which is a subset of supervised learning, as the name would suggest. Calling ...
Phillip Maire's user avatar
1 vote

What technique is used for training Large Language Models like GPT?

These models are trained with unsupervised learning, but it's probably more intuitive to describe it as self-supervised learning. Your confusion makes sense: the next-token prediction objective, which ...
Alexander Wan's user avatar
0 votes

What is the difference between self-supervised and unsupervised learning?

It's misleading to think of these as separate learning paradigms. Self-supervised learning IS an unsupervised learning algorithm that uses certain methods to derive learning signals without explicit ...
Jing's user avatar
  • 101

Top 50 recent answers are included