All Questions
Tagged with variational-autoencoder diffusion-models
9 questions
2
votes
1
answer
180
views
Deriving ELBO for Diffusion Models
I am trying to read through the proof of ELBO for diffusion models on pg. 8 of this paper. However, I do not see how the author arrived at Eqn (45) from Eqn (44). Specifically, I do not know how they ...
2
votes
1
answer
93
views
Derivation of the consistency term in the DDPM Evidence Lower Bound (ELBO) [closed]
I have been studying diffusion models from this tutorial: https://arxiv.org/abs/2403.18103 and trying to derive all results as I read it. Although this tutorial is very comprehensive, it skips many of ...
- 31
1
vote
1
answer
218
views
Trying to understand some derivation in the paper: Deep Unsupervised Learning using Nonequilibrium Thermodynamics
I have recently been learning about diffusion models and trying to derive all the results in the paper by Sohl-Dickstein, et. al, "Deep Unsupervised Learning using Nonequilibrium Thermodynamics&...
- 31
0
votes
0
answers
60
views
What best practices for VAE do you know?
The data is binary voxel data of shape (60, 36, 60). I want to compress such data into ...
0
votes
1
answer
833
views
Why does the latent space in Stable Diffusion have a shape of 64x64x3?
Since the encoding is performed by a Variational Autoencoder, the VAE encoder must output some mean and log variance that we can ...
0
votes
0
answers
24
views
How to apply Latent Diffusion for 3D Binary Voxel Data?
Suppose we have a voxel of shape (60, 36, 60) with values 0 or 1 (1-occupied, 0-empty). What is the possible architecture of latent diffusion?
1
vote
1
answer
190
views
What is an information bottleneck in the context of ELBO and Hierarchical VAEs?
These slides (slide number 26) mention that the ELBO enforces an information bottleneck at the latent variables z which make it prone to bad local minima.
Can you please explain what they mean by that?...
2
votes
1
answer
988
views
What exactly is meant by variational distribution?
What specifically does the term "variational distribution" refer to?
The encoder of Variational autoencoder?
Forward process of denoising diffusion probabilistic models?
Images or latent ...
0
votes
2
answers
163
views
How to expand reconstruction error to mean squared error in Variational AutoEncoder? [closed]
How to expand reconstruction error to mean squared error when it is $\mathbb{E}_{z\sim q_{\phi}(z|x)}[\log p_\theta(x|z)]$?
[reconstruction error]
$\mathbb{E}_{z\sim q_{\phi}(z|x)}[\log p_\theta(x|z)]$...