Questions tagged [weight-normalization]
The weight-normalization tag has no usage guidance.
3
questions
0
votes
0answers
33 views
What's the best way to normalize 2D input data?
Currently I'm working on a project that the input to the network is SWT of a signal which is 2D array. Currently I'm using batch normalization to normalize inputs(Stationary Wavelet Transform of ...
2
votes
1answer
154 views
Can you help me understand how weight normalization works?
I am trying to dissect the paper Weight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural Networks.
Unfortunately, because my math is a little bit rusty, I got a little ...
6
votes
1answer
144 views
How to solve the problem of too big activations when using genetic algorithms to train neural networks?
I am trying to create a fixed-topology MLP from scratch (with C#), which can solve some simple problems, such as the XOR problem and MNIST classification. The network will be trained purely with ...
