All Questions
Tagged with features convolutional-neural-networks
10 questions
4
votes
2
answers
60
views
Is there any proper literature on the types of features that different layers of a deep neural network learn?
Let's consider a deep convolutional network. It seems that there is some consensus on the following notions:
1. Shallow layers tend to recognise more low-level features such as edges and curves.
2. ...
- 141
2
votes
2
answers
411
views
How to convert color information to 1D feature vector?
We are making a classification model that takes a clip of a movie as an input and predicts who the director is. Roughly speaking, it will be a model that understands film directors' unique style.
We ...
0
votes
0
answers
51
views
Does it make sense to compare images (samples) with words (features)?
Consider the following paragraphs from the introduction of the chapter named Recurrent Neural Networks from the textbook titled Dive into Deep Learning
So far we encountered two types of data: ...
- 3,990
2
votes
1
answer
439
views
Is it true that channels always represent colours of an image?
Convolutional neural networks are widely used in image-related tasks in artificial intelligence.
The input of a conventional neural network is generally an image. The output of a convolutional neural ...
- 3,990
2
votes
0
answers
936
views
What does it mean by "low-level" and "high-level" in features generated by CNN?
Across the literature, the terms "high-level" and "low-level" are generally used as an adjective to the features generated by the convolution neural network as intermediate ...
- 3,990
3
votes
2
answers
121
views
How do we know that the neurons of an artificial neural network start by learning small features?
I'd like to ask you how do we know that neural networks start by learning small, basic features or "parts" of the data and then use them to build up more complex features as we go through ...
- 573
3
votes
1
answer
77
views
How are small scale features represented in an Inverse Graphics Network (autoencoder)?
This post refers to Fig. 1 of a paper by Microsoft on their Deep Convolutional Inverse Graphics Network:
https://www.microsoft.com/en-us/research/wp-content/uploads/2016/11/kwkt_nips2015.pdf
Having ...
- 161
2
votes
1
answer
328
views
If I wanted to calculate multiple feature maps in a convolutional layer, should the filters be trained individually?
Assume I have an input of size $32 \times 32 \times 3$ and pass it to a convolution layer. Now, if my kernel size were to be $5 \times 5 \times 3$ and the depth of my convolution layer were to be 1, ...
- 158
2
votes
2
answers
687
views
Is the number of feature maps equal to the number of kernels in the LeNet 5 architecture?
In LeNet 5's first layer, the number of feature maps is equal to the number of kernels. However, the second convolutional layer has a depth different from the 3rd layer. Does the filter size dictate ...
- 317
1
vote
2
answers
250
views
Which neuron represents which part of the input?
In a neural network, each neuron represents some part of the input. For example, in the case of a MNIST digit, consider the stem of the number 9. Each neuron in the NN represents some part of this ...
- 111