In a neural network, by how much does the # of neurons typically vary from layer to layer?
I am NOT asking how to find the optimal # of neurons per lyr.
As a hardware design engineer with no practical experience programming neural networks, I would like to glean for example...
- By how much does the number of neurons in hidden layers typically vary from that of the input layer?
- What is the maximum deviation in the # of hidden lyr neurons to the # of input layer neurons?
- How commonly do you see a large spike in the number of neurons?
It likely depends on the application so I would like to hear from as many people as possible. Please tell me about your experience.