# Questions tagged [probability-theory]

For questions related to probability theory in the context of artificial intelligence.

21 questions
Filter by
Sorted by
Tagged with
4k views

### Are softmax outputs of classifiers true probabilities?

BACKGROUND: The softmax function is the most common choice for an activation function for the last dense layer of a multiclass neural network classifier. The outputs of the softmax function have ...
• 962
603 views

### What are the main benefits of using Bayesian networks?

I have some trouble understanding the benefits of Bayesian networks. Am I correct that the key benefit of the network is that one does not need to use the chain rule of probability in order to ...
1k views

### How do compute the table for $p(s',r|s,a)$ (exercise 3.5 in Sutton & Barto's book)?

I am trying to study the book Reinforcement Learning: An Introduction (Sutton & Barto, 2018). In chapter 3.1 the authors state the following exercise Exercise 3.5 Give a table analogous to that ...
• 255
563 views

• 40.9k
158 views

### How would the probability of a document $P(d)$ be computed in the Naive Bayes classifier?

In naive Bayes classification, we estimate the class of a document as follows $$\hat{c} = \arg \max_{c \in C} P(c \mid d) = \arg \max_{c \in C} \dfrac{ P(d \mid c)P(c) }{P(d)}$$ It has been said in ...
• 3,890
1 vote
123 views

### Which formula of p(x, y) to use?

The probability distribution $p(x, y)$ can be calculated in two ways : $p(x, y) = p(y \mid x) p(x)$ $p(x, y) = p(x \mid y) p(y)$ But according to the book Deep Generative Modeling (page number 3 ...
• 175
1 vote
334 views

### Why are today's neural networks not modeled with probability theory?

In the paper The Perceptron: A probabilistic model for information storage and organization in the brain, Rosenblatt used the probability theory to model his perceptron. My professor told me that ...
• 11
1 vote
102 views

### Understanding how to calculate $P(x|c_k)$ for the Bernoulli naïve Bayes classifier

I'm looking at the Bernoulli naïve Bayes classifier on Wikipedia and I understand Bayes theorem along with Gaussian naïve Bayes. However, when looking at how $P(x|c_k)$ is calculated, I don't ...
• 65
1 vote
102 views

• 111