Questions tagged [conditional-probability]

For questions related to conditional probability e.g. in the context of Bayesian inference or networks.

Filter by
Sorted by
Tagged with
0
votes
0answers
19 views

How can Kneser-Ney Smoothing be integrated into a neural language model?

I found a paper titled Multimodal representation: Kneser-Ney Smoothing/Skip-Gram based neural language model. I am curious about how can Kneser-Ney Smoothing technique be integrated into a feed-...
1
vote
0answers
52 views

How is per-decision importance sampling derived in Sutton & Barto's book?

In per-decison importance sampling given in Sutton & Barto's book: Eq 5.12 $\rho_{t:T-1}R_{t+k} = \frac{\pi(A_{t}|S_{t})}{b(A_{t}|S_{t})}\frac{\pi(A_{t+1}|S_{t+1})}{b(A_{t+1}|S_{t+1})}\frac{\pi(...
1
vote
0answers
23 views

How do I sample conditionally from deep belief networks?

Deep belief networks (DBNs) are generative models, where, usually, you sample by thermalising the deepest layer (as it's a restricted Boltzmann machine), and then forward propagating a sample towards ...
1
vote
1answer
32 views

Solving the supervised learning problem of learning $p(y \vert \mathbf{x})$ by using traditional unsupervised technologies to learn $p(\mathbf{x}, y)$

I am currently studying Deep Learning by Goodfellow, Bengio, and Courville. In chapter 5.1.2 The Performance Measure, $P$, the authors say the following: Unsupervised learning and supervised learning ...
2
votes
2answers
258 views

What is probability distribution in machine learning?

If we were learning or working in machine learning field then we frequently come across this term probability distribution. I know what probability, conditional probability and probability ...
5
votes
1answer
266 views

What is “conditioning” on a feature?

On page 98 of Jet Substructure at the Large Hadron Collider: A Review of Recent Advances in Theory and Machine Learning the author writes; Redacted phase space: Studying the distribution of inputs ...
4
votes
5answers
172 views

Why isn't conditional probability sufficient to describe causality?

I read these comments from Judea Pearl saying we don't have causality, physical equations are symmetric, etc. But the conditional probability is clearly not symmetric and captures directed ...
2
votes
1answer
106 views

What to do when PDFs are not Gaussian/Normal in Naive Bayes Classifier

While analyzing the data for a given problem set, I came across a few distributions which are not Gaussian in nature. They are not even uniform or Gamma distributions(so that I can write a function, ...
1
vote
0answers
31 views

What is the point of converting conditional probability to factor for Variable Elimination?

I have this slide from my AI class on using a Bayes network to compute a conditional probability. I don't really understand the point of converting the conditional probabilities to factors (besides ...
-2
votes
1answer
84 views

What is Bayes' theorem and error?

What is Bayes' theorem and Bayes' error?