Questions tagged [convolution]

For questions related to the convolution operation or convolutional layer (in the case of convolutional neural networks).

Filter by
Sorted by
Tagged with
4
votes
0answers
34 views

Transformer: Position-wise Feed-Forward network

The Transformer model introduced in "Attention is all you need" by Vaswani et al. incorporates a so-called position-wise feed-forward network (FFN): In addition to attention sub-layers, each of the ...
0
votes
0answers
7 views

Looking for the right type of 1D-Convolution that only considers one column/attribute

My input has the shape of n rows (time steps) and m columns (attributes). I want to train a convolutional neural network on it to predict a class. I am currently using 1D-Convolutions. I got a good ...
3
votes
1answer
51 views

Is it useful to eliminate the less relevant filters from a trained CNN?

Imagine I have a tensorflow CNN model with good accuracy but maybe too many filters: Is there a way to determine which filters have more impact in output? I think it should be possible. At least, if ...
4
votes
1answer
29 views

Combining mean pooling and max pooling

Is it popular or effective to concatenate the results of mean-pooling and max-pooling? To get the invariance of the latter and the expressivity of the former.
2
votes
2answers
52 views

Why do we get a three-dimensional output after a convolutional layer?

In a convolutional neural network, when we apply the convolution on a $5 \times 5$ image with $3 \times 3$ kernel, with stride $1$, we should get only one $4 \times 4$ as output. In most of the CNN ...
4
votes
1answer
60 views

What is the difference between asymmetric and depthwise separable convolution?

I have recently discovered asymmetric convolution layers in deep learning architectures, a concept which seems very similar to depthwise separable convolutions. Are they really the same concept with ...
4
votes
2answers
142 views

When should I use 3D convolution?

I am new to convolutional neural networks, and I am learning 3D convolution. What I could understand is that 2D convolution gives us relationships between low-level features in the X-Y dimension, ...
6
votes
1answer
96 views

What are the benefits of using max-pooling in convolutional neural networks?

I am reading Francois Chollet's Deep learning with Python, and I came across a section about max-pooling that's really giving me trouble. I am unable to copy-paste the content, so I've included ...
0
votes
1answer
45 views

Why does Convolutional layer unde usually has the same input/output channel size?

As famous model VGG16 shows(and other famous models), The convolutional layers before pooling usually have the same input and output channel sizes? What's the reason for that? Is there a theory or ...
0
votes
2answers
73 views

How should the values of the filters of a CNN change?

I wrote a convolutional neural network for the MNIST dataset with Numpy from scratch. I am currently trying to understand every part and calculation. But one thing I noticed was the "just positive" ...
0
votes
0answers
31 views

How is the convolution operation used in CNNs a special case of the convolution operator?

How is the convolution operation used in convolutional neural networks (CNNs) a special case of the mathematical convolution operator? Most of us, when we think of the "convolution operation", we ...