Skip to main content
Became Hot Network Question
edited title
Link
nbro
  • 41.4k
  • 12
  • 114
  • 205

How can youwe compute the ratio between the probability distributions in importance samplingif we don't know one of the distributions?

deleted 14 characters in body; edited tags; edited title
Source Link
nbro
  • 41.4k
  • 12
  • 114
  • 205

Importance sampling - Computing How can you compute the ratio between the probability distributions in importance sampling?

Here is my understanding of importance sampling. If we have two distributions $p(x)$ and $q(x)$, where we have a way of sampling from $p(x)$ but not from $q(x)$, but we want to compute the expectation wrt $q(x)$, then we use importance sampling.

The formula goes as follows:

$$ E_q[x] = E_p\Big[x\frac{q(x)}{p(x)}\Big] $$

The only limitation is that we need a way to compute the ratio. Now, here is what I don't understand. Without knowing the density function $q(x)$, how can we compute the ratio $\frac{q(x)}{p(x)}$?

Because if we know $q(x)$, then we can compute the expectation directly.

I am sure I am missing something here, but I am not sure what. Can someone help me understand this?

Thank you.

Importance sampling - Computing the ratio

Here is my understanding of importance sampling. If we have two distributions $p(x)$ and $q(x)$, where we have a way of sampling from $p(x)$ but not from $q(x)$, but we want to compute the expectation wrt $q(x)$, then we use importance sampling.

The formula goes as follows:

$$ E_q[x] = E_p\Big[x\frac{q(x)}{p(x)}\Big] $$

The only limitation is that we need a way to compute the ratio. Now, here is what I don't understand. Without knowing the density function $q(x)$, how can we compute the ratio $\frac{q(x)}{p(x)}$?

Because if we know $q(x)$, then we can compute the expectation directly.

I am sure I am missing something here, but I am not sure what. Can someone help me understand this?

Thank you.

How can you compute the ratio between the probability distributions in importance sampling?

Here is my understanding of importance sampling. If we have two distributions $p(x)$ and $q(x)$, where we have a way of sampling from $p(x)$ but not from $q(x)$, but we want to compute the expectation wrt $q(x)$, then we use importance sampling.

The formula goes as follows:

$$ E_q[x] = E_p\Big[x\frac{q(x)}{p(x)}\Big] $$

The only limitation is that we need a way to compute the ratio. Now, here is what I don't understand. Without knowing the density function $q(x)$, how can we compute the ratio $\frac{q(x)}{p(x)}$?

Because if we know $q(x)$, then we can compute the expectation directly.

I am sure I am missing something here, but I am not sure what. Can someone help me understand this?

Source Link
pecey
  • 343
  • 2
  • 10

Importance sampling - Computing the ratio

Here is my understanding of importance sampling. If we have two distributions $p(x)$ and $q(x)$, where we have a way of sampling from $p(x)$ but not from $q(x)$, but we want to compute the expectation wrt $q(x)$, then we use importance sampling.

The formula goes as follows:

$$ E_q[x] = E_p\Big[x\frac{q(x)}{p(x)}\Big] $$

The only limitation is that we need a way to compute the ratio. Now, here is what I don't understand. Without knowing the density function $q(x)$, how can we compute the ratio $\frac{q(x)}{p(x)}$?

Because if we know $q(x)$, then we can compute the expectation directly.

I am sure I am missing something here, but I am not sure what. Can someone help me understand this?

Thank you.