New answers tagged

1 vote
Accepted

What is the potential issue of nested neural networks

Isn't this just a very short recurrent neural network? Same issues apply, although they are less severe since you aren't applying as many recurrent iterations. Once you start "nesting" them ...
NikoNyrh's user avatar
  • 737
0 votes

Why is dot-product and not Euclidean distance used for attention?

Dot-product attention and Euclidean distance-based attention are not necessarily similar, differing only in terms of computational cost. I wrote a recent paper to report that using the Euclidean ...
calmcc's user avatar
  • 101

Top 50 recent answers are included