Questions tagged [weight-normalization]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0
votes
0answers
25 views

What's the best way to normalize 2D input data?

Currently I'm working on a project that the input to the network is SWT of a signal which is 2D array. Currently I'm using batch normalization to normalize inputs(Stationary Wavelet Transform of ...
2
votes
1answer
132 views

Can you help me understand how weight normalization works?

I am trying to dissect the paper Weight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural Networks. Unfortunately, because my math is a little bit rusty, I got a little ...