I wonder what happens to the 'channels' dimension (usually 3 for RGB images) after the first convolution layer in CNNs?
In books and other sources, it is always said that the depth of the output from convolutional layers is the number of kernels (filters) in that layer.
But, if the input image has 3 channels and we convolve each of them with $K$ kernels, shouldn't the depth of the output be $K * 3$? Are they somehow 'averaged' or in other way combined with each other?
@nbro, otherwise, I don't see your comments. $\endgroup$