All Questions
Tagged with layer-normalization residual-networks
1 question
0
votes
2
answers
2k
views
Layer Norm in a ResNet MLP
Where do you insert layer norm in a residual block?
After the addition or before the activation function (RELU in this case)?