Questions tagged [knowledge-distillation]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0
votes
1answer
28 views

What is the difference between Mean Teacher and Knowledge Distillation?

I recently read two papers: BYOL Bootstrap your own latent: A new approach to self-supervised Learning DINO Emerging Properties in Self-Supervised Vision Transformers. I am confused about the terms ...