New answers tagged computational-learning-theory
1
Model/network design has multiple guidelines, a basic one is: The solving capacity of the network should be larger than the possibility space of the problem to be solved.
Solving capacity (learning capacity) of a network (dense usually) can be calculated as the product of number of neurons in all layers, for example:
Input shape: 10 values
Network shape: [...
1
The most obvious way more classes increase the network size it the output layer, but I don't believe there is a rule of thumb for the size of the entire network.
As I understand it, there is no clear answer how big a network needs to be to achieve a certain performance with regard to the number of layers compared to the number of classes. This is a very ...
Top 50 recent answers are included
Related Tags
computational-learning-theory × 60machine-learning × 29
neural-networks × 20
vc-dimension × 14
deep-learning × 9
pac-learning × 9
comparison × 8
vc-theory × 8
proofs × 7
universal-approximation-theorems × 6
generalization × 5
classification × 4
capacity × 4
reference-request × 3
terminology × 3
overfitting × 3
probability × 3
books × 3
no-free-lunch-theorems × 3
hypothesis-class × 3
reinforcement-learning × 2
math × 2
definitions × 2
deep-neural-networks × 2
theory × 2