# Questions tagged [convolution]

For questions related to the convolution operation in mathematics, convolutional neural networks, image processing and computer vision.

74 questions
Filter by
Sorted by
Tagged with
91 views

### In this paper, if region $R_{2}$ moves in a sliding window manner, won't the saliency map have a smaller size than the original image?

In the paper Salient Region Detection and Segmentation, I have a question pertaining to section 3 on the convolution-like operation being performed. I had already asked a few questions about the paper ...
85 views

### How do I choose the hyper-parameters for a model to detect different guitar chords?

I need to build a hand detector that recognizes the chord played by a hand on a guitar. I read this article Static Hand Gesture Recognition using Convolutional Neural Network with Data Augmentation ...
38 views

### Is it possible to apply 2D convolution to 1D data?

Suppose that I have a 1D dataset with 6 features. Can I apply a 2D convolutional neural net to this dataset?
28 views

### Why does $I_N + D^{-\frac{1}{2}}AD^{-\frac{1}{2}}$ have eigenvalues in the range [0, 2]

In Semi-supervised classification with Graph Convolutional Networks, I am unable to understand few things. Given an undirected graph having adjacency matrix $A$, degree matrix $D_{ii} = \sum_j A_{ij}$ ...
16 views

### Attention vs Global Depthwise convolution

The main advantages of the self-attention mechanism are: Ability to capture long-range dependencies Ease to parallelize on GPU or TPU However, I wonder, why the same goals cannot be achieved by ...
55 views

### Why do we lose detail of an image as we go deeper into a ConvNet?

I was reading this research paper titled 'Image Style Transfer using Convolutional Neural Networks' which as the title suggests was based on Neural Style Transfer. I came across this line which didn't ...
56 views

### Why do we add 1 in the formula to calculate the shape of the output of the convolution?

In the formula to calculate output shape of tensor after convolution operation $$W_2 = (W_1-F+2P)/S + 1,$$ where: $W_2$ is the output shape of the tensor $W_1$ is the input shape $F$ is the filter ...
8 views

### Dose the input channels of depth-wise convolution must be same with output channels?

Just learned the concept of group convolution and depth-wise convolution, I am confused what the difference between depth-wise and group convolution is. Does the input channels of depth-wise ...
32 views

### Is a convolutional layer capable of converting, for example, a binary image into an RGBA image?

I am asking this question for a better understanding of the concept of channels in images. I am aware that a convolutional layer generates feature maps from a given image. We can adjust the size of ...
30 views

### Is there any animation that illustrates the "fold" and "unfold" operations of convolutional layers?

There are fourteen convolution layers in PyTorch. Among them six are related to convolution, another six are related to transposed convolution. The remaining two are fold and unfold operations. The ...
35 views

### What does 'input planes' mean in the phrase 'input signal/image composed of several input planes'?

PyTorch documentation provided the following descriptions to the Convolution layers ...
61 views

### What does 'channel' mean in the case of an 1D convolution?

While reading about 1D-convolution in PyTorch, I encountered the concept of channels ...
42 views

### How is the convolution operation connected to neural networks?

I've been reading up on the convolution operation and neural networks. I understand that the convolution operation is defined as: $$(f * g)(t)=\int_{-\infty}^{\infty} f(\tau) g(t-\tau) d \tau$$ The ...
15 views

### More channels vs multiple inputs in neural network

Suppose I want to train the model for playing chess. I found that existing models use as input the grid with dimensions 8x8x20 (so we have 20 channels). Some channels may represent how different kind ...
26 views

### Positional encoding in convolutional layers

Positional encoding (PE) is an essential part of the self-attention layers in the transformer architectures since without adding it in some way (fixed of learnable) to the input embeddings model has ...
39 views

### How to implement a (3 + 2)-dimensional convolutional layer where the 2d space is "internal"?

I am trying to train a CNN to learn 5D (kind of) data. The data is structured as follows. It has three spatial dimensions [x, y, z], but it also has two "...
26 views

### Why the non-exploitation of edge labels in current graph convolutions "results in an overly homogeneous view of local graph neighborhoods"?

I am currently reading a paper called Dynamic Edge-Conditioned Filters in Convolutional Neural Networks on Graphs (2017, CPPR), and I cannot understand the following sentence: We identify that the ...
153 views

### Convolutional Layer Multichannel Backpropagation Implementation

I have been working on coding a CNN in python from scratch using numpy as a semester project and I think I have successfully implemented it up to backpropagation in the MaxPool Layers. However, my ...
409 views

### What is the difference between same convolution and full convolution in terms of feature map size?

In valid convolution, the size of the output shrinks at each layer. So after some point of time additional layers cannot meaningfully performs convolution. For this reason, same convolution is ...
46 views

### Why might the convolution be inappropriate when the task involves incorporating information from very distant locations in the input?

When I am reading about convolutional neural networks, I have encountered the following sentence from the textbook(page 341) that says about the limitation of the usage of the convolution in CNNs. ...
26 views

### Which layer to route out of layers of same width and height in Yolo implementation?

In Yolo configuration files (like yolo3.cfg in dark-net), there are many layers with output of same height and width due to ...
27 views

### What is meant by "real-valued argument" in this context of the convolution operation?

Consider the following statement from Deep Learning book (p. 327, chapter 9: Convolutional Networks) In its most general form, convolution is an operation on two functions of a real-valued argument. ...
103 views

### Is it a good idea to use different width and height of the kernel in a CNN?

I always see that the width and height of the kernel are the same. But is it a good idea to use different numbers? Recently I tried to use GoogLeNet (which expects images to be 224x224) on my images (...
68 views

### What do the variables in the cross-correlation formula mean?

I understand what cross-correlation does given a kernel and an input image, but the formula confuses me a little. Given here in Goodfellow's Deep Learning (page 329), I can't quite understand what $m$ ...
156 views

### Conversion of convolution filter weights between NCHW and NHWC formats

Popular deep learning frameworks have different default data formats (PyTorch with NCHW, TensorFlow with NHWC), which lead to published pretrained models with weights that may have an incompatible ...
85 views

### What is the use of the regular convolutional layer in expansion path of U-Net?

I was going through the paper on U-Net. U-net consists of a contracting path followed by an expanding path. Both the paths use a regular convolutional layer. I understand the use of convolutional ...
29 views

### Do filters have as many layers as the depth of the input in CNNs? [duplicate]

Firstly as an example here is the architecture of YOLOv2 I am trying to understand the depth of an output of a convolutional layer. For example, the first convolutional layer has the shape 3x3x32. So ...
91 views

### Is there anything that ensures that convolutional filters don't end up the same?

I trained a simple model to recognize handwritten numbers from the mnist dataset. Here it is: ...
37 views

47 views

### How will the input be preserved as we go deeper in CNN, where dimensions decrease drastically?

Our length of feature representation decreases as we go deeper into the CNN, I mean to say that horizontal and vertical lengths decrease while depth(channels) increase. So, how will the input be ...
476 views

### Do convolutional neural networks perform convolution or cross-correlation?

Typically, people say that convolutional neural networks (CNN) perform the convolution operation, hence their name. However, some people have also said that a CNN actually performs the cross-...
36 views

### Is there a difference between using 1d conv layers and 2d conv layers with kernel with size of 1 along other than time dimension?

Let's assume I use convolutional networks for time-series prediction. Data I feed to the network have 1 channel depth, height of number of periods and number of features is the width, so the frame ...
61 views

### How do we choose the filters for the convolutional layer of a convolution neural network?

Since the hidden layers of a CNN work as a trainable feature extractor, more detailed content based on a larger number of pixels shall require bigger filter sizes. But for cases where localized ...
116 views

### Are activation functions applied to feature maps?

If I have a convolutional neural network, and I convolve my input tensor with a kernel, the output is a feature map. Is an activation function then applied to this feature map? If its an image that ...
195 views

### What is the point of using 1D and 2D convolutions with a kernel size of 1 and 1x1 respectively?

I understand the gist of what convolutional neural networks do and what they are used for, but I still wrestle a bit with how they function on a conceptual level. For example, I get that filters with ...
82 views

### How is the convolution layer is usually implemented in practice?

Following an earlier question, I'm interested in understanding the basics of Conv2d and especially how the kernel is applied, summed, and the propagated. I ...