Questions tagged [fully-connected-layer]

For questions related to fully connected layers (which are often used as the last layers of a convolutional neural network).

Filter by
Sorted by
Tagged with
0
votes
1answer
39 views

Why my Fully Connected Neural Network outputs the same prediction?

I have a relatively small data set comprised of $3300$ data points where each data point is a $13$ dimensional vector where the $12$ first dimensions depict a "category" by taking the form ...
0
votes
1answer
41 views

Must all CNNs and RNNs not have a fully connected layer in order to be considered as such?

In the paper Wrist-worn blood pressure tracking in healthy free-living individuals using neural networks, the authors talk about a combination of feed-forward and recurrent layers, as if FC layers ...
0
votes
0answers
53 views

What is the difference between the forward pass of the Multi-Layer Perceptron, Deep AutoEncoder and Deep Belief Network?

Multi-Layer Perceptron (MLP), Deep AutoEncoder (DAE), and Deep Belief Network (DBN) are trained differently. However, do they follow the same process during the inference phase, i.e., do they ...
2
votes
1answer
51 views

What's the purpose of layers without biases?

I noticed that the TensorFlow library includes a use_bias parameter for the Dense layer, which is set to ...
0
votes
0answers
100 views

How to determine the number of fully connected layers for a convolutional neural network?

How many fully connected layers should be added to a convolutional neural network? Does it depend on input size to the fully connected layer? If so, how do we decide? What if the input size of the ...
0
votes
1answer
59 views

Why does the output shape of a Dense layer contain a batch size?

I understand that the batch size is the number of examples you pass into the neural network (NN). If the batch size is 10, it means you feed the NN 10 examples at once. Assuming I have an NN with a ...
0
votes
0answers
32 views

What is the purpose to have fully connected layers?

What is the purpose of a fully connected multi layer perceptron in which every input is connected to every output by a weight? After all, the information is only distributed over several channels, but ...
2
votes
3answers
122 views

Why does a neuron in a multi-layer network need several input connections?

For example, if I have the following architecture: Each neuron in the hidden layer has a connection from each one in the input layer. 3 x 1 Input Matrix and a 4 x 3 weight matrix (for the ...
1
vote
1answer
63 views

Can fully connected layers be used for feature detection?

I need help in understanding something basic. In this video, Andrew Ng says, essentially, that convolutional layers are better than fully connected (FC) layers because they use fewer parameters. But I'...
1
vote
0answers
63 views

When to use convolutional layers as opposed to fully connected layers?

I am still new to CNNs, but I would like to check my understanding between when to use convolutional layers versus fully connected layers. From what I have read, we can use convolutional layers with ...