Questions tagged [bottlenecks]

For questions about "bottlenecks" in dimensional reduction, typically in reference to Artificial Neural Networks and Autoencoders.

Filter by
Sorted by
Tagged with
1 vote
1 answer
188 views

What does it mean by bottleneck and representational bottleneck in feedforward neural networks?

Consider the following paragraph from section 2: General Design Principles of the research paper titled Rethinking the Inception Architecture for Computer Vision ...
  • 3,481
0 votes
1 answer
200 views

Autoencoder: predictions missing for nodes in the bottleneck layer

I'm using tf.Keras to build a deep-fully connected autoencoder. My input dataset is a dataframe with shape (19947,), and the purpose of the autoencoder is to predict normalized gene expression values. ...
  • 11
2 votes
0 answers
30 views

Does bottleneck size matter in Disentangled Variational Autoencoders?

I suppose that picking an appropriate size for the bottleneck in Autoencoders is neither a trivial nor an intuitive task. After watching this video about VAEs, I've been wondering: Do disentangled ...
  • 21
28 votes
2 answers
31k views

What are "bottlenecks" in neural networks?

What are "bottlenecks" in the context of neural networks? This term is mentioned, for example, in this TensorFlow article, which also uses the term "bottleneck values". How does ...
12 votes
2 answers
15k views

What are bottleneck features?

In the blog post Building powerful image classification models using very little data, bottleneck features are mentioned. What are the bottleneck features? Do they change with the architecture that is ...