CLIP: https://openai.com/research/clip

They use a small text encoder and suggest that the simpler the model the better. Is there any reason why that is? Has anyone tried using a pretrained LLM as the text encoder and then fine tuning? I would assume the LLM would learn a lot better representation of the meaning of the text.



You must log in to answer this question.

Browse other questions tagged .