Questions tagged [autoencoders]
For questions about autoencoders, a type of unsupervised artificial network for learning efficient data codings.
9
questions
12
votes
4
answers
3k
views
What are the purposes of autoencoders?
Autoencoders are neural networks that learn a compressed representation of the input in order to later reconstruct it, so they can be used for dimensionality reduction. They are composed of an encoder ...
- 38.2k
2
votes
1
answer
68
views
Do Le et al. (2012) train all three autoencoder layers at a time, or just one?
Le et al. 2012 use a network of 1 billion parameters to learn neurons that respond to faces, cats, pedestrians, etc. without labels (unsupervised).
Their network is built with three autoregressive ...
- 151
1
vote
1
answer
61
views
Why is training all layers at a time effective for a multi-layer autoencoder?
This training of all layers of a CNN simultaneously is standard practice today. It is found in every CNN (AlexNet (2012), VGG, Inception, GANs, etc) and even pre-CNN networks such as Le et al. 2012.
...
- 151
1
vote
1
answer
1k
views
How to determine the number of hidden layers and units of a deep auto-encoder?
I am using a deep autoencoder for my problem. However, the way I choose the number of hidden layers and hidden units in a hidden layer is still based on my feeling.
The size of the model that ...
- 27
10
votes
3
answers
2k
views
What is the difference between encoders and auto-encoders?
How are the layers in a encoder connected across the network for normal encoders and auto-encoders? In general, what is the difference between encoders and auto-encoders?
- 333
9
votes
3
answers
10k
views
Why is the variational auto-encoder's output blurred, while GANs output is crisp and has sharp edges?
I observed in several papers that the variational autoencoder's output is blurred, while GANs output is crisp and has sharp edges.
Can someone please give some intuition why that is the case? I did ...
- 269
4
votes
2
answers
673
views
Can I apply reparametrization trick on "any" deep neural network?
I came across the "reparametrization trick" for the first time in the following paragraph from the chapter named Vector Calculus from the test book titled Mathematics for Machine Learning ...
- 3,531
1
vote
2
answers
1k
views
What is the advantage of using a VAE over a deterministic auto-encoder?
What is the advantage of using a VAE over a deterministic auto-encoder?
For example, assuming we have just 2 labels, a deterministic auto-encoder will always map a given image to the same latent ...
- 225
0
votes
1
answer
260
views
What is the best loss function for convolution neural network and autoencoder? [closed]
What is the best choice for loss function in Convolution Neural Network and in Autoencoder in particular - and why?
I understand that the MSE is probably not the best choice, because little ...
- 169