Questions tagged [skip-gram]
The skip-gram tag has no usage guidance.
2 questions with no upvoted or accepted answers
0
votes
0
answers
45
views
Skip-Gram Model description in word2vec explanation article
In his article word2vec Parameter Learning Explained Xin Rong says (page 7):
Each output is computed using the same hidden->output matrix:
$$ p(w_{c,j} = w_{O.c}|w_I)=y_{c,j}=\frac{exp(u_{c,j})}{\...
- 188
0
votes
0
answers
25
views
Can 3D convolutions appropriately capture a frozen embedding space?
My project is a strange combination of NLP and Computer Vision.
I have datapoints of 3D tensor where each element is a token in an NLP vocabulary. The vocabulary is around 1000 unique "words"...
- 1