Skip to main content

Questions tagged [contrastive-learning]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0 votes
0 answers
26 views

Is there a better way for my CNN to handle random values?

I made an autoencoder to, ideally, turn an image into seemingly random numbers(Using a loss that determines randomness) and turn those random numbers into the original image. The results were kind of ...
Nathanael Suarez's user avatar
2 votes
2 answers
194 views

Definition of negatives in NT-Xent loss

I'm trying to understand few details about NT-Xent loss defined in SimCLR paper(link). The loss is defined as $$\mathcal{l}_{i,j} = -\log\frac{\exp(sim(z_i,z_j)/\tau)}{\sum_{k=1}^{2N}\mathbb{1}_{[k\...
James Arten's user avatar
9 votes
1 answer
7k views

What is the difference between the triplet loss and the contrastive loss?

What is the difference between the triplet loss and the contrastive loss? They look same to me. I don't understand the nuances between the two. I have the following queries: When to use what? What ...
Exploring's user avatar
  • 343
1 vote
1 answer
122 views

Embedding Quality of Transfer Learning model vs Contrastive learning model

I am working on Contrastive learning which is a technique to learn features based on the concept of learning from comparing two or more instances. The downstream task is a classification problem. ...
Raj Rajeshwari Prasad's user avatar
2 votes
2 answers
970 views

Why does triplet loss allow to learn a ranking whereas contrastive loss only allows to learn similarity?

I am looking at this lecture, which states (link to exact time): What the triplet loss allows us in contrast to the contrastive loss is that we can learn a ranking. So it's not only about similarity, ...
Gulzar's user avatar
  • 759
1 vote
1 answer
780 views

What is the difference between Mean Teacher and Knowledge Distillation?

I recently read two papers: BYOL Bootstrap your own latent: A new approach to self-supervised Learning DINO Emerging Properties in Self-Supervised Vision Transformers. I am confused about the terms ...
Đặng Huy Hoàng's user avatar
1 vote
0 answers
154 views

How to use K-means clustering to visualise learnt features of a CNN model?

Recently, I was going through the paper Intriguing Properties of Contrastive Losses. In the paper (section 3.2), the authors try to determine how well the SimCLR framework has allowed the ResNet50 ...
VEDANT JOSHI's user avatar