Questions tagged [dense-layers]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
1
vote
0answers
26 views

Are there any benefits of adding attention to linear layers?

Is attention useful only in transformer/convolution layers? Can I add it to linear layers? If yes, how (on a conceptual level, not necessarily the code to implement the layers)?