Questions tagged [glove]

For questions related to the GloVe (Global Vectors for Word Representation), which is an unsupervised learning algorithm for obtaining vector representations for words.

Filter by
Sorted by
Tagged with
1
vote
0answers
17 views

Is there a way to parallelize GloVe cooccur function?

I would like to create a GloVe word embedding on a very large corpus (trillions of words). However, creating the co-occurence matrix with the GloVe cooccur script is projected to take weeks. Is there ...
4
votes
1answer
68 views

Are most things generally discovered because they work empirically and later justified mathematically, or vice-versa?

In the original GloVe paper, the authors discuss group theory when coming up with equation (4). Is it possible that the authors came up with this model, figured out it was good, and then later found ...
2
votes
0answers
16 views

Doubt on formulating cost function for GloVe

I'm reading the notes here and have a doubt on page 2 ("Least squares objective" section). The probability of a word $j$ occurring in the context of word $i$ is $$Q_{ij}=\frac{\exp(u_j^Tv_i)}{\sum_{w=...
1
vote
0answers
42 views

How could I learn tree paths given word embeddings?

I need to map from a vector space representation onto a tree structure. A possible solution: given a word vector as input, produce a path in the tree from the root down to the node that most closely ...