Questions tagged [naive-bayes]

For questions related to the naive Bayes, which is a machine learning (or statistics) technique that is based on the Bayes' theorem.

Filter by
Sorted by
Tagged with
3
votes
0answers
36 views

Why do Bayesian algorithms work well with small datasets?

I read very often that Bayesian algorithms work well on small datasets. Why is that? I think it is because they might generalize more, but why is that? See also Investigating the use of Bayesian ...
0
votes
0answers
28 views

How to build naive bayes graph from data

For an university assignment I have to use the HuginLite software to do some probabilistic inferences with different algorithms. One of these algorithms is Naive Bayes but its graph is not built ...
1
vote
2answers
92 views

What to do when PDFs are not Gaussian/Normal in Naive Bayes Classifier

While analyzing the data for a given problem set, I came across a few distributions which are not Gaussian in nature. They are not even uniform or Gamma distributions(so that I can write a function, ...
3
votes
1answer
111 views

What is the relationship between MLE and naive Bayes?

I have found various references describing Naive Bayes and they all demonstrated that it used MLE for the calculation. However, this is my understanding: $P(y=c|x)$ $\propto$ $P(x|y=c)P(y=c)$ with $...
4
votes
1answer
130 views

Why is the denominator ignored in the Bayes' rule?

The naive Bayes' generative algorithm is often represented by the following formula $$\text{argmax}_{y} p(y \mid x) = \text{argmax}_y \frac{p(x|y)p(y)}{p(x)} \approx \text{argmax}_y p(x|y)p(y)$$ Why ...
4
votes
1answer
220 views

Is logistic regression more free from the conditional independence assumption than naive Bayes?

To my understanding, logistic regression is an extension of naive Bayes. Suppose $X = \{x_1, x_2, \dots, x_N \}$ and $Y = \{0, 1\}$, each $x_i$ is i.i.d and $P(x_i \mid Y=y_k) \sim \mathcal{N}(\mu, \...
3
votes
1answer
116 views

What is the most effective way to build a classifier?

At the moment, I am working on a project which requires me to build a naive Bayes classifier. Right now, I have a form online asking for people to submit a sentence and the subject of the sentence, in ...