Questions tagged [glove]

For questions related to the GloVe (Global Vectors for Word Representation), which is an unsupervised learning algorithm for obtaining vector representations for words.

Filter by
Sorted by
Tagged with
1 vote
0 answers

Is there a way to parallelize GloVe cooccur function?

I would like to create a GloVe word embedding on a very large corpus (trillions of words). However, creating the co-occurence matrix with the GloVe cooccur script is projected to take weeks. Is there ...
J. Montgomery's user avatar
5 votes
1 answer

Are most things generally discovered because they work empirically and later justified mathematically, or vice-versa?

In the original GloVe paper, the authors discuss group theory when coming up with the equation (4). Is it possible that the authors came up with this model, figured out it was good, and then later ...
Damien's user avatar
  • 169
2 votes
0 answers

Doubt on formulating cost function for GloVe

I'm reading the notes here and have a doubt on page 2 ("Least squares objective" section). The probability of a word $j$ occurring in the context of word $i$ is $$Q_{ij}=\frac{\exp(u_j^Tv_i)}{\sum_{w=...
Shirish Kulhari's user avatar