Questions tagged [bayesian-networks]
For questions related to Bayesian networks, which are e.g. used to study causality (or causation) in AI.
29
questions
0
votes
0
answers
14
views
Requesting resources on causal networks for 2D strategy game
I am requesting research, articles, abstracts or interesting opinions that will help me create a complex causal neural network. There are many detailed resources on causal discovery, image recognition,...
0
votes
1
answer
27
views
What is the difference between an input and observed data in a Bayesian neural network?
I'm new to the Bayesian perspective and would appreciate clarity on this.
In a few resources concerning Bayesian deep learning (such as this one), I see this notation:
$p(y|x, D) = \int p(y|x, \theta)...
- 3
1
vote
0
answers
60
views
Calculation of the CPTs in a Dynamic Bayesian Network
I am trying to figure out how to build my DBN (with pyAgrum), and I am a bit confused. Let us say I have the network on the next figure.
I am interested in the variable $B$. At each time $t$, I am ...
- 11
1
vote
0
answers
10
views
variational inference but with a weighted loglikelihood
I would like to know if it's correct if I substitute in the ELBO formula
a weighted sum of the loglikelihood
$$\sum E_{q_{\theta}(w)}[w_i \ln{p(y_i|f^{w}(x_i))}]$$
in place of the traditional sum.
...
- 111
-1
votes
1
answer
79
views
Given A and B, C are independent of each other. Given A, B and C, D and E are independent of each other. What is the minimal number of parameters?
Assuming all variables $A, B, C, D,$ and $E$ are random binary variables. I come up with Bayes net: $D \rightarrow B \rightarrow A \leftarrow C \leftarrow E$ which has the minimal number of parameters ...
- 1
0
votes
1
answer
60
views
Why are Directed Graphical Models considered ML methods?
Consider the following problem. The probability of being born in countries [1,2,3,4] is given by [a, b, c, d] respectively. This is a categorical problem.
Now, assume that the height of a person ...
0
votes
0
answers
50
views
What makes Sequential Bayesian Filtering and Smoothing tractable?
I'm currently diving into the Bayesian world and I find it pretty fascinating.
I've so far understood that applying the Bayes' Rule, i.e.
$$\text{posterior} = \frac{\text{likelihood}\times \text{prior}...
- 1
0
votes
1
answer
85
views
What does all the formula and pictures mean?
https://www.nature.com/articles/s41467-020-17419-7
I am a medical school graduate and I really want to learn AI/ML for computer-aided diagnosis.
I was building a symptom checker and I found the ...
- 103
1
vote
0
answers
17
views
In the original GAN paper, why is it mentioned that you can sample deep directed graphical models without a Markov chain?
In the original GAN paper (table 2), why is it mentioned that you can sample deep directed graphical models without a Markov chain (well, they say without difficulties, but others list MCMC as a ...
- 11
2
votes
0
answers
30
views
What are the practical problems where full bayesian treatment is affordable?
Suppose, I have a problem, where there is rather a small number of training samples, and transfer learning from ImageNet or some huge NLP dataset is not relevant for this task.
Due to the small number ...
- 2,564
0
votes
1
answer
45
views
What Constitutes Messages in Junction Tree Algorithm?
I'm currently studying the Junction Tree Algorithm: I'm referring to the process of transforming a Bayesian Network into a Junction Tree in order to apply inference. I understand how you build the ...
- 25
2
votes
1
answer
64
views
In Probabilistic Graphical Model (written by Daphne Koller), what's the meaning of "parameter" in representation of the distribution?
I just started to read the PGM book written by Daphne Koller.
In the chapter of Bayesian Network Representation(Chapter 3), there are some descriptions about the standard parameterization of the joint ...
- 21
3
votes
1
answer
155
views
How are the "Link Strength true", "Link Strength blind" and "Mutual Information" calculated in this report on Bayesian networks?
I'm trying to understand how to calculate the strength of every arc in a Bayesian Network.
I came across this report Measuring Connection Strengths and Link Strengths in Discrete Bayesian Networks, ...
- 31
2
votes
0
answers
26
views
Deriving hyperparameter updates in Online Interactive Collaborative Filtering
I've been going through "Online Interactive Collaborative Filtering Using Multi-Armed Bandit with Dependent Arms" by Wang et al. and am unable to understand how the update equations for the ...
6
votes
2
answers
903
views
What is the difference between a Bayesian Network and a Markov Chain?
I am trying to understand the difference between a Bayesian Network and a Markov Chain.
When I search for this one the web, the unanimous solution seems to be that a Bayesian Network is directional (...
- 163
4
votes
0
answers
288
views
How can I draw a Bayesian network for this problem with birds?
I am working on the following problem to gain an understanding of Bayesian networks and I need help drawing it:
Birds frequently appear in the tree outside of your window in the morning and ...
- 41
3
votes
1
answer
540
views
Why do Bayesian algorithms work well with small datasets?
I read very often that Bayesian algorithms work well on small datasets. Why is that? I think it is because they might generalize more, but why is that?
See also Investigating the use of Bayesian ...
- 579
3
votes
1
answer
67
views
How do I determine the most appropriate classifier for a certain problem?
Consider a Bayesian classifier used in spam e-mail filtering. It converts an e-mail to a vector, most of the time using the bag-of-words method. Although it learns first before getting employed, it ...
user27450
1
vote
2
answers
239
views
Can maximum likelihood be used as a classifier?
I am confused in understanding the maximum likelihood as a classifier. I know what is Bayesian network and I know that ML is used for estimating the parameters of models. Also, I read that there are ...
- 131
1
vote
0
answers
76
views
What is the point of converting conditional probability to factor for Variable Elimination?
I have this slide from my AI class on using a Bayes network to compute a conditional probability. I don't really understand the point of converting the conditional probabilities to factors (besides ...
- 351
1
vote
3
answers
98
views
Is it possible to compute $P( F \mid S )$ given $P(F \mid S,A)$ and $P(F \mid S, \lnot A)$ in Bayesian network?
I have a bayesian network, which has the following data:
$P(S) = 0.07$
$P(A) = 0.01$
$P(F \mid S,A) = 1.0$
$P(F \mid S, \lnot A) = 0.7$
$P(F \mid \lnot S, A) = 0.9$
$P(F \mid \lnot S, \lnot A) =...
- 11
1
vote
1
answer
117
views
Problem with Proposition 1 of Google Deepmind's 'Weight uncertainty in Neural Networks'
I'm going through the paper Weight Uncertainty in Neural Networks by Google Deepmind. In the final line of the proof of proposition 1, the integral and the derivative are swapped. Then the derivative ...
- 21
8
votes
1
answer
469
views
What are the main benefits of using Bayesian networks?
I have some trouble understanding the benefits of Bayesian networks.
Am I correct that the key benefit of the network is that one does not need to use the chain rule of probability in order to ...
- 181
1
vote
2
answers
69
views
Can we derive the distribution of a random variable based on a dependent random variable's distribution?
In the diagram below, there are three variables: X3 is a function of (depends on) X1 and X2, ...
- 111
1
vote
1
answer
61
views
How to perform structure learning for Bayesian network given already partially constructed Bayesian network?
Let's assume that we have a dataset of variables (random events)I apriori would like to set dependency conditions between some of them and perform structure learning to figure out the rest of the ...
- 11
2
votes
3
answers
711
views
What is the definition of a heuristic function in the BayesChess paper?
I am reading BayesChess: A computer chess program based on Bayesian networks (Fernandez, Salmeron; 2008)
It is a chess-playing engine using Bayesian networks. The following is mentioned about the ...
- 187
1
vote
1
answer
462
views
What does a hybrid Bayesian network contain?
The field of artificial intelligence is so vast. There are many methodologies for handling continuous data, and I have just read about the hybrid Bayesian network. I just want to know that what a ...
- 75
2
votes
1
answer
963
views
Why is exact inference in a Bayesian network both NP-hard and P-hard?
I should show that exact inference in a Bayesian network (BN) is NP-hard and P-hard by using a 3-SAT problem.
So, I did formulate a 3-SAT problem by defining 3-CNF:
$$(x_1 \lor x_2) \land (\neg x_3 \...
- 423
5
votes
2
answers
796
views
Are Bayesian networks important to learn in 2018?
I study AI by myself with the book "Artificial Intelligence: A Modern Approach". I've just finished the chapters about the Bayesian network and probabilities, and I found them very interesting. Now, I ...
- 173