Questions tagged [convolutional-neural-networks]

For questions about convolutional neural networks, also known as CNN or ConvNet.

Filter by
Sorted by
Tagged with
2
votes
1answer
218 views

If vanishing gradients are NOT the problem that ResNets solve, then what is the explanation behind ResNet success?

I often see blog posts or questions on here starting with the premise that ResNets solve the vanishing gradient problem. The original 2015 paper contains the following passage in section 4.1: We ...
2
votes
1answer
42 views

Accuracy scores in a Deep Learning project

I'm using three pre-trained deep learning models to detect vehicles and count from an image data set. The vehicles belong to one of these classes ['car', 'truck', 'motorcycle', 'bus']. So, for a ...
2
votes
1answer
773 views

Which neural network architectures are there that perform 3D convolutions?

I am trying to do 3d image deconvolution using convolution neural network. But I cannot find many famous 3d CNNs. Can anyone point out some for me? Background: I am using PyTorch, but any language ...
1
vote
1answer
691 views

How should I implement the backward pass through a flatten layer of a CNN?

I am making a NN library without any other external NN library, so I am implementing all layers, including the flatten layer, and algorithms (forward and backward pass) from scratch. I know the ...
1
vote
1answer
131 views

What is the best loss function for convolution neural network and autoencoder?

What is the best choice for loss function in Convolution Neural Network and in Autoencoder in particular - and why? I understand that the MSE is probably not the best choice, because little ...
1
vote
0answers
45 views

Doubt regarding research paper on Crowd Counting using Convolutional neural networks and Markov Random Field

I am currently reading the research paper Image Crowd Counting Using Convolutional Neural Network and Markov Random Field by Kang Han, Wanggen Wan, Haiyan Yao, and Li Hou. I did not understand the ...
1
vote
1answer
124 views

How to mathematically describe the convolution operation (with a Gaussian kernel)?

I have to build a model where I pre-process the data with a Gaussian kernel. The data are an $n\times n$ matrix (i.e one channel), but not an image, thus I can't refer to this matrix as an image and ...
1
vote
1answer
130 views

Are commercially available neural ICs digital?

Apparently, one can buy a special-purpose integrated circuit (an IC like this one, for instance) to host a convolutional neural network. QUESTION Is such a circuit digital? Except for digital random-...
1
vote
2answers
179 views

Why is the validation performance better than the training performance?

I am training a classifier to identify 24 hand signs of American Sign Language. I created a custom dataset by recording videos in different backgrounds for each of the signs and later converted the ...
0
votes
1answer
38 views

Attention mechanism: Why apply multiple different transformations to obtain query, key, value

I have two questions about the structure of attention modules: Since I work with imagery I will be talking about using convolutions on feature maps in order to obtain attention maps. If we have a set ...
0
votes
1answer
49 views

Pixel-Level Detection of Each Object of the Same Class In an Image

I have source data that can be represented as a 2D image of many similar curves. They may oftentimes cross over one another, so regions of interest will overlap. My goal is to implement a neural ...
0
votes
0answers
28 views

How can my CNN produce an "unknown" label?

I have a dataset of 20k images of infected mango. I have built a web-based app using Flask, where a user can upload a picture, and my CNN model detects the disease. I have 6 classes in the model, ...

1
2