Skip to main content
Search type Search syntax
Tags [tag]
Exact "words here"
Author user:1234
user:me (yours)
Score score:3 (3+)
score:0 (none)
Answers answers:3 (3+)
answers:0 (none)
isaccepted:yes
hasaccepted:no
inquestion:1234
Views views:250
Code code:"if (foo != bar)"
Sections title:apples
body:"apples oranges"
URL url:"*.example.com"
Saves in:saves
Status closed:yes
duplicate:no
migrated:no
wiki:no
Types is:question
is:answer
Exclude -[tag]
-apples
For more details on advanced search visit our help page
Results tagged with
Search options questions only not deleted user 46842

For questions related to variational auto-encoders (VAEs). The first VAE was proposed in "Auto-Encoding Variational Bayes" (2013) by Diederik P. Kingma and Max Welling. There are several other VAEs, for example, the conditional VAE.

2 votes
1 answer
94 views

Why do we use $q_{\phi}(z \mid x^{(i)})$ in the objective function of amortized variational ...

In page 21 here, it states: General Idea of Amortization: if same inference problem needs to be solved many times, can we parameterize a neural network to solve it? Our case: for all $x^{(i)}$ we wan …
a12345's user avatar
  • 243
0 votes
1 answer
310 views

For the VAE, should the input, output and latent variable code be random variables?

For a variational autoencoder, we have input $x$ (assume 1 data point for now, like an image), a latent code sampled from the decoder, $z$, and an output $\hat{x}$. If I were to draw a diagram for the …
a12345's user avatar
  • 243
1 vote
1 answer
335 views

Do we use two distinct layers to compute the mean and variance of a Gaussian encoder/decoder...

I am looking at appendix C of the VAE paper: It says: C.1 Bernoulli MLP as decoder In this case let $p_{\boldsymbol{\theta}}(\mathbf{x} \mid \mathbf{z})$ be a multivariate Bernoulli whose probabiliti …
a12345's user avatar
  • 243
2 votes
3 answers
222 views

Are the authors of the VAE paper writing the PDFs as a function of the random variables?

Usually, I see the conventions: discrete random variable is denoted as $X$, the pmf is written as $P(X=x)$ or $p(X=x)$ or $p_{X}(x)$ or $p(x)$, where $x$ is an instance of $X$ a continuous random var …
a12345's user avatar
  • 243
1 vote
1 answer
634 views

How is the VAE related to the Autoencoding Variational Bayes (AEVB) algorithm?

I am familiar with the variational autoencoder, but not totally clear on what exactly the AEVB is. In the original VAE paper (by Kingma and Welling), he uses both the terms variational autoencoder and …
a12345's user avatar
  • 243
4 votes
1 answer
1k views

How does the VAE learn a joint distribution?

I found the following paragraph from An Introduction to Variational Autoencoders sounds relevant, but I am not fully understanding it. A VAE learns stochastic mappings between an observed $\mathbf{x} …
a12345's user avatar
  • 243
3 votes
1 answer
298 views

What are the roles of the prior $\mathrm{p}(\mathbf{z})$ in a VAE?

I know the encoder is variational posterior $q_{\phi}(\mathbf{z} \mid \mathbf{x})$. I also know that the decoder represents the likelihood: $p_{\theta}(\mathbf{x} \mid \mathbf{z})$. My question is abo …
a12345's user avatar
  • 243