All Questions
Tagged with hyper-parameters natural-language-processing
2 questions
4
votes
1
answer
4k
views
What's the relationship between number of heads and embedding dimension in Transformers?
I am reading the book: Natural Language Processing with Transformers. It has the following paragraph
Although head_dim does not have to be smaller than the number of embedding dimensions of the ...
- 670
0
votes
2
answers
176
views
How to reduce the number of clusters produced by the Markov Clustering Algorithm?
I have used the Markov Clustering Algorithm (MCL) to cluster tweets, based on their similarity. However, I got a too high number of clusters, and most of the clusters have only one tweet. Any ...
