Skip to main content

Questions tagged [layer-normalization]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
14 votes
1 answer
10k views

What are the consequences of layer norm vs batch norm?

I'll start with my understanding of the literal difference between these two. First, let's say we have an input tensor to a layer, and that tensor has dimensionality $B \times D$, where $B$ is the ...
Alexander Soare's user avatar