New answers tagged attention
1
vote
Why are embeddings added, not concatenated?
First of all, I think it is very hard to properly reason about these things, but there are a few points that might justify using sum instead of concatenation.
For example, concatenation would have the ...
- 326
Top 50 recent answers are included