Questions tagged [layer-normalization]
The layer-normalization tag has no usage guidance.
1
question
14
votes
1
answer
7k
views
What are the consequences of layer norm vs batch norm?
I'll start with my understanding of the literal difference between these two. First, let's say we have an input tensor to a layer, and that tensor has dimensionality $B \times D$, where $B$ is the ...
- 1,319