A homograph - is a word that shares the same written form as another word but has a different meaning.
They can be even different parts of speech. For example:
- close(verb) - close(adverb)
- lead(verb) - lead(noun)
- wind(noun) - wind(verb)
And there is rather a big list https://en.wikipedia.org/wiki/List_of_English_homographs.
As far as I understand, after processing the text data in any conventional way, lemmatization, building an embedding, these words, despite having different meaning, and appearing in different contexts, would be absolutely the same for the algorithm, and in the end we would get some averaged context between two or more meainings of the word. And this embedding would be meaningless.
How is this problem treated or these words are regarded to be too rare to have a significant impact on the quality of resulting embedding?
I would appreciate comments and references to the papers or sources