A neural network can apparently be denoted as $N_{t,n,\sigma,L}$. What do these subscripts $t, n, \sigma$ and $L$ mean? Could you link me to a paper, article or webpage with an explanation for this?
1 Answer
Here is a paper with the mathematical definition of each term:
Let Nt,n,σ,L be all target functions that can be implemented using a neural network of depth t, size n, activation function σ, and when we restrict the input weights of each neuron to be |w|1 + |b| ≤ L.
-
$\begingroup$ Does "size $n$" mean that the network has $n$ input nodes? $\endgroup$– J. DoeNov 13, 2019 at 9:08
-
1$\begingroup$ Check the introduction: "The depth of the network is the number of layers and the size of the network is the total number of neurons." $\endgroup$– seraliNov 13, 2019 at 9:13