Questions tagged [probability-theory]
For questions related to probability theory in the context of artificial intelligence.
5
questions
1
vote
1answer
44 views
How would the probability of a document $P(d)$ be computed in the Naive Bayes classifier?
In naive Bayes classification, we estimate the class of a document as follows
$$\hat{c} = \arg \max_{c \in C} P(c \mid d) = \arg \max_{c \in C} \dfrac{ P(d \mid c)P(c) }{P(d)} $$
It has been said in ...
2
votes
2answers
130 views
Why is the equation $\mathbb{E} \left[ (Y - \hat{Y})^2 \right] = \left(f(X) - \hat{f}(X) \right)^2 + \operatorname{Var} (\epsilon)$ true?
In the book An Introduction to Statistical Learning, the authors claim (equation 2.3, p. 19, chapter 2)
$$\mathbb{E} \left[ (Y - \hat{Y})^2 \right] = \left(f(X) - \hat{f}(X) \right)^2 + \operatorname{...
0
votes
1answer
67 views
Bayesian Perceptron: Why to marginalize over neuron's output instead of it's weights?
I found a very interesting paper on the internet that tries to apply Bayesian inference with a gradient-free online-learning approach: Bayesian Perceptron: Towards fully Bayesian Neural Networks.
I ...
0
votes
0answers
57 views
How can the V and Q functions take the expectation over a sum where the number of summands is random?
Assume the existence of a Markov Decision Process consisting of:
State space $S$
Action space $A$
Transition model $T: S \times A \times S \to [0,1]$
Reward function $R: S \times A \times S \to \...
3
votes
1answer
114 views
Why is the equation $r(s', a, s') =\sum_{r \in \mathcal{R}} r \frac{p\left(s^{\prime}, r \mid s, a\right)}{p\left(s^{\prime} \mid s, a\right)}$true?
I am referring to eq. 3.6 (page 49) based on Sutton's online book and can be found in an image below.
I could not make sense of the final derivation of the equation $r(s, a, s')$. My question is ...
