Questions tagged [convolution]

For questions related to the convolution operation or convolutional layer (in the case of convolutional neural networks).

4 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
6
votes
0answers
89 views

Why would you implement the position-wise feed-forward network of the transformer with convolution layers?

The Transformer model introduced in "Attention is all you need" by Vaswani et al. incorporates a so-called position-wise feed-forward network (FFN): In addition to attention sub-layers, each of the ...
0
votes
0answers
7 views

Looking for the right type of 1D-Convolution that only considers one column/attribute

My input has the shape of n rows (time steps) and m columns (attributes). I want to train a convolutional neural network on it to predict a class. I am currently using 1D-Convolutions. I got a good ...
0
votes
1answer
48 views

Why does Convolutional layer unde usually has the same input/output channel size?

As famous model VGG16 shows(and other famous models), The convolutional layers before pooling usually have the same input and output channel sizes? What's the reason for that? Is there a theory or ...
0
votes
0answers
34 views

How is the convolution operation used in CNNs a special case of the convolution operator?

How is the convolution operation used in convolutional neural networks (CNNs) a special case of the mathematical convolution operator? Most of us, when we think of the "convolution operation", we ...