Questions tagged [hidden-layers]

For questions about functioning, applications, structure and improvement of performance of hidden layers in a Neural Network.

Filter by
Sorted by
Tagged with
21 votes
5 answers
3k views

Why does Batch Normalization work?

Adding BatchNorm layers improves training time and makes the whole deep model more stable. That's an experimental fact that is widely used in machine learning practice. My question is - why does it ...
Kostya's user avatar
  • 2,515
8 votes
1 answer
3k views

Do all neurons in a layer have the same activation function?

I'm new to machine learning (so excuse my nomenclature), and not being a python developer, I decided to jump in at the deep (no pun intended) end writing my own framework in C++. In my current design, ...
lfgtm's user avatar
  • 230
7 votes
4 answers
4k views

What is the purpose of the hidden layers?

Why would anybody want to use "hidden layers"? How do they enhance the learning ability of the network in comparison to the network which doesn't have them (linear models)?
kenorb's user avatar
  • 10.5k
7 votes
3 answers
4k views

Does each filter in each convolution layer create a new image? [duplicate]

Say I have a CNN with this structure: input = 1 image (say, 30x30 RGB pixels) first convolution layer = 10 5x5 convolution filters second convolution layer = 5 3x3 convolution filters one dense layer ...
RocketNuts's user avatar