Questions tagged [dense-layers]
The dense-layers tag has no usage guidance.
1
question
1
vote
0answers
26 views
Are there any benefits of adding attention to linear layers?
Is attention useful only in transformer/convolution layers? Can I add it to linear layers? If yes, how (on a conceptual level, not necessarily the code to implement the layers)?
