Questions tagged [convolutional-neural-networks]
For questions about convolutional neural networks, also known as CNN or ConvNet.
984
questions
0
votes
0answers
2 views
Deep NN architecture for predicting a matrix from a matrix and list of floats
I am trying to predict a matrix (size RxC) based on an input matrix (size RxC) and a list of floats ...
1
vote
1answer
17 views
Is reconciling shape discrepancies the only purpose of padding?
Padding is a technique used in some of the domains of artificial intelligence.
Data is generally available in different shapes. But in order to pass the data as input to a model in deep learning, the ...
0
votes
0answers
11 views
Feeding the output back to input in 3D CNN model
I am currently designing a Model which takes Input 3D Grid and Model Output at $t-1$. The model figure is described below
I have two thoughts in training the model for above situation.
Feed output $...
0
votes
0answers
13 views
How Tesla and other companies use outputs from neural networks to drive the car?
Here is the short description of Tesla Autopilot AI:
https://www.tesla.com/autopilotAI
And here are some videos about how Tesla uses neural networks:
Andrej Karpathy - AI for Full-Self Driving at ...
0
votes
1answer
42 views
Is it possible to use deep learning to generate a 2D image from a few numerical values?
Is it possible to train a DL model that will generate a full resolution 2D image based on few numbers describing this image and what type of model or architecture would that be?
What I want to ...
0
votes
0answers
14 views
Scrabble-MuZero: combine observation planes of different shape
I'm working on an implementation of Scrabble with MuZero. The board state is represented by a matrix with shape $15 \times15 \times 27$ ($26$ letters $+ 1$ wildcard, value $0/1$) and the rack state $...
1
vote
0answers
29 views
Is there any animation that illustrates the “fold” and “unfold” operations of convolutional layers?
There are fourteen convolution layers in PyTorch. Among them six are related to convolution, another six are related to transposed convolution. The remaining two are fold and unfold operations.
The ...
1
vote
0answers
10 views
Is there any gain by lazy initialization of weights, biases and number of input channels for a convolution operation?
The basic layers for performing convolution operation in PyTorch are
...
0
votes
0answers
12 views
Prune Neural Networks layers for f% sparsity - TensorFlow2
I am using TensorFlow 2.5 and Python3.8 where I have a simple TF2 CNN having one conv layer and an output layer for binary classification as follows:
...
0
votes
0answers
6 views
The ratio between number of units in multi-input model
I have the model that accepts two inputs:
Image from camera
Speed of the car
I can create some CNN layers to process the image input and some MLP layers to process other type of data (for example ...
1
vote
0answers
24 views
How can I compute a mathematical formula for my CNN?
Let's say, for example, I have built the following CNN model using Keras:
...
1
vote
1answer
38 views
How is the convolution operation connected to neural networks?
I've been reading up on the convolution operation and neural networks. I understand that the convolution operation is defined as:
$$(f * g)(t)=\int_{-\infty}^{\infty} f(\tau) g(t-\tau) d \tau$$
The ...
0
votes
0answers
15 views
What is the primary paper demonstrating that CNNs struggle with datasets containing ambiguities? [closed]
It is known that neural networks, such as convolutional neural networks, struggle with pattern recognition if training sets contain ambiguities (i.e. several labels can correspond to one and the same ...
1
vote
0answers
25 views
Using a rectified Tanh to train a CNN?
I have been experimenting with activation functions on CNN, and it occurred to me to use a rectified tanh function. So that is basically if z > 0 tanh(z) else 0. ...
0
votes
0answers
12 views
Comparing results of different image splicing methods on a part of the CASIA 2.0 dataset
So I am working on an image splicing detection algorithm using ResNet-50 model. I am using the CASIA 2.0 dataset which consists of 7491 Authentic images and 5123 Fake images. However out of the fake ...
-1
votes
0answers
10 views
How to get output as “saliency map”/“heatmap” of a tenserflow CNN model in a webapp deployed in HEROKU using flask? [closed]
I can implement saliency map of image in notebook . But , how can i get the saliency map / heatmap as output along with predition of tuberculosis . I deployed the webapp in HEROKU using flask.
0
votes
0answers
42 views
Does randomly adding hand-engineered features increase the CNN's sample efficiency/performance?
It is a known fact that preprocessing images using CV techniques will improve CNN performance (see this answer).
But what happens when you feed in the entire image and the filtered image randomly to ...
2
votes
1answer
31 views
What does “differentiable architecture” mean?
I'm currently reading a paper that uses CNN's as a base approach to solving some image classification issues and I've found that they kept mentioning the term "Differentiable Architecture", ...
0
votes
0answers
19 views
What image augmentations can help a neural network identify the smallest pixels within an image?
I am training a CNN to identify objects and I believe the network will learn much faster if it can learn to focus on the smallest pixels. One way to go about this would be to augment the images before ...
1
vote
0answers
35 views
What causes high differences in neural network accuracy each run?
I trained a CNN using Keras in R to multi-dimensional image data for image classification of five classes. I realized that each run (I retrained the network on the same data for ten times), although I ...
0
votes
0answers
18 views
Computational complexity of a CNN network
In the following network, the convolution operations of convolutional blocks are performed by three 1-D kernels with the sizes 8, 5, and 3 respectively along with stride equal to 1. The final network ...
2
votes
1answer
39 views
Are there any advantages of the local attention against convolutions?
Transformer architectures, based on the self-attention mechanism, have achieved outstanding performance in a variety of applications.
The main advantage of this approach is that the given token can ...
3
votes
1answer
44 views
Can some of the weights be fixed during the training of a neural network?
Is it possible to exclude specific layers from the optimization?
For example, let's say I have an input layer, 2 hidden layers, and the output layer. I know there is a perfect solution for my problem ...
0
votes
0answers
11 views
How to scale Computer Vision? How to implement Emotion detection from live video feed of N different video simultaneously?
I have a pipeline based on Scaled Yolov4 detection algorithm for faces which extract faces of users and then uses a CNN to ...
0
votes
0answers
7 views
Image classification distributed inference (mobile/server)
I'd like to learn some stuff about distributed DNN inference and how it works in practice.
So, let's consider the example of image classification and assume we have a mobile device which utilizes the ...
1
vote
0answers
25 views
Convolutional Neural Network (CNN) with Tree architecture to organize the number of classes
At the moment, I have around 1.000 classes with accuracy and loss that are acceptable. In the long term, there could be more than 100.000 classes. The main problem is that every time a new class is ...
1
vote
0answers
18 views
What is a Silhouette Neural Network
I was going through a study in which I found something called a dilated Silhouette Neural Network. I want to know what it is, what it can do, and how it is better from a CNN?
Link to the journal: Link
1
vote
0answers
8 views
Vector input to CNN for object detection
I am training a 3D object detection network (Retinanet-based as of the moment) for re-detecting tracked objects. I would like to be able to add the velocity vector of the tracked object as an input to ...
0
votes
2answers
28 views
Is “Pruning” only applicable to CNNs?
What Is Neural Network Pruning And Why Is It Important Today?
The above article only talks about Convolutional Neural Networks:
One of the first methods of pruning is pruning entire convolutional ...
0
votes
0answers
13 views
Looking for advice on how to train an AI object detection algorithm to recognize smaller objects than what it has been trained on
For some academic work, I am training an AI object detection algorithm (TensorFlow models) to look for specific objects (plants, in my case). I am taking photos with a hand-held camera, and am having ...
0
votes
0answers
20 views
Regress values inside the bounding boxes to predict a value in Object Detection
I am currently working on an object detection task. I have a dataset of Grayscale and Depth Images. The annotation format is x1, y1, x2, y2, class, depth. I have calculated this depth (of each object/...
1
vote
0answers
14 views
More channels vs multiple inputs in neural network
Suppose I want to train the model for playing chess. I found that existing models use as input the grid with dimensions 8x8x20 (so we have 20 channels). Some channels may represent how different kind ...
0
votes
0answers
9 views
Loss function to Push response value towards extremes
I have a feature map whose values are in the range of [0,1]. I want to push these values either towards extreme 0 or 1 using some loss function. Since I don't have any target value so it had to be in ...
0
votes
0answers
33 views
AI model to predict/generate person's image
I want to make a model that predicts person's shape depending on his son's image.
My plan is to create a dataset and each data point in it consists of two images; One for the father or mother and one ...
2
votes
1answer
55 views
What gets optimized in convolutional neural network?
In a convolutional neural network, the hyperparameters such as number of kernels and stride, kernel size, etc are determined. After some combination of convolutions, ReLU and pooling layer there is ...
0
votes
0answers
25 views
How to change number of trained layers in object detection TensorFlow models?
Training custom object detection models with TensorFlow usually means a transfer learning of pre-trained models and, if I understand it correctly, it means only training the few last layers, with ...
0
votes
0answers
26 views
How can a CNN be used in machine translation?
How can a convolutional neural net (CNN) be used in machine translation?
Convolution is a mathematical operation, so how are natural languages translated into matrices?
e.g., DeepL_Translator#...
0
votes
0answers
12 views
In CNN, how the conversion of convolution layer to fully connected layer decides the no. of kernel
I am trying to understand the shape of the activation map after every operation. Here is the model summary . All is clear, but from the point labeled 1, how 7x7x512 turns out to be 4096 specifically ...
0
votes
0answers
15 views
How is the size of the class activation maps related to the size of the input images?
According to the images of the block diagram of class activation maps on the Internet, it seems that these images are a weighted sum of feature maps of the last convolutional layer as shown in the ...
0
votes
1answer
36 views
How is parameter sharing done in CNN?
I am trying to understand the concept of parameter sharing in a convolution neural network from Parameter Sharing. I have a few confusions:
Parameter sharing refers to the fact that for generating a ...
1
vote
0answers
19 views
What is the conceptual difference between convolutional neural networks and auto-encoders?
I'm familiar with Auto-Encoders and I'm about to dive into CNNs. By having a look at the most important component of a CNN, the filter:
I wonder how it is different from Auto-Encoders:
For me, it ...
0
votes
0answers
38 views
Dilated CNN - How to deal with odd lookbacks?
I'm currently working with a dilated CNN to solve a regression problem. I am trying to forecast 24 timesteps ahead based on 6, 12 and 24 values (lookback). However I am not sure which dilation rate ...
0
votes
0answers
7 views
Evaluating a convolutional neural network on an imbalanced (academic) dataset
I have trained a posture analysis network to classify in a video of humans recorded in public places if there is a) shake-hand between two humans, b) Standing close together that their hands touch ...
0
votes
0answers
11 views
How to change a single object detection network to a multiple object detection network?
I have trained a CNN network to detect a circle and approximate its centre and radius in an image. What I want to do now is detect the centre and radius of all the circles if there are multiple ...
0
votes
0answers
6 views
How can I get the images with the highest activation for a given unit?
I am new to machine learning. I am working on the pretrained AlexNet on Pytorch and i would like to visualize the receptive fields of a given unit U. To do that I am trying to give like 200K images as ...
3
votes
1answer
69 views
Are these visualisations the filters of the convolution layer or the convolved images with the filters?
There are several images related to convolutional networks on the Internet, an example of which I have given below
My question is: are these images the weights/filters of the convolution layer (the ...
0
votes
1answer
58 views
Feeding CNN FFT of an image, a dumb idea?
My dataset consists of about 40,000 200x200px grayscale images of centered blobs bathed in noise and occasional artifacts like stripes other blobs of different shapes and sizes, fuzzy speckles and so ...
0
votes
0answers
24 views
Why and when transformers are better than CNN's in sequence modeling tasks?
Transformers have made a revolution in the domain of NLP and gave rise to a rapid boost of neural networks in a variety of language modelling problems, TTS and, recently, achieved competitive accuracy ...
1
vote
0answers
20 views
What is the best way to train neural network with imbalanced mixed data (images and structured data)?
I have structured data and image data to solve a regression problem. One sample of structured data can be related to N images.
If I use only structured data, I get decent performance, but not enough ...
1
vote
0answers
11 views
CFD Reinforcement Learning Topology optimization wind tunnel
I want to create a reinforcement learning environment, designed for win tunnel simulations, where for each iteration a deep convolutional model could receive the 3D vector/scalar fields from the past ...
