In LeNet 5's first layer, the number of feature maps is equal to the number of kernels. However, the second convolutional layer has a depth different from the 3rd layer. Does the filter size dictate the number of feature maps?
$\begingroup$
$\endgroup$
2
-
1$\begingroup$ Which LeNet5's picture are you looking at? $\endgroup$– nbroMay 16, 2019 at 10:01
-
$\begingroup$ medium.com/@shahariarrabby/… in short my doubt is this. does the filter size dictates the number of feature maps or the vice versa? $\endgroup$– Stephen PhilipMay 17, 2019 at 4:56
Add a comment
|
2 Answers
$\begingroup$
$\endgroup$
1
In this case, each kernel has the same depth as the depth of the input cuboid. In the architecture above, we have an (input) cuboid of dimension $14 \times 14 \times 6$, where $6$ is the depth, which is followed by an (output) cuboid of dimension $10 \times 10 \times 16$, where $16$ is the depth, which is the number of (output) feature maps (or channels) and it is also equal to the number of kernels applied to the (input) cuboid of dimensions $14 \times 14 \times 6$. Each of these $16$ kernels has a depth of $6$. So, each of these $16$ kernels has a shape of $5\times 5 \times 6$.
In general, the depth of the input cuboid can be different than the depth of the output cuboid, which is often equal to the number of kernels applied to the input cuboid (but this is not always the case). Furthermore, the depth of each kernel (applied to the input cuboid) has (often) the same depth as the input cuboid.
-
$\begingroup$ Source of the image: https://harangdev.github.io/deep-learning/convolutional-neural-networks/25/. $\endgroup$– nbroMay 17, 2019 at 13:25
$\begingroup$
$\endgroup$
The # of kernels will be the channel length, looking at the image you posted in your comment from post, I do not understand where you see the inconsistency.
