Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [probability-distribution]

For questions related to AI theory that relies on the knowledge of a distribution of probabilities across one or more dimensions affecting probability. Such a distribution may be in discrete buckets, such as quartile, octile, or percentile conventions or continuous functions based on some closed form (algebraic formula). Distributions of probability are key in planning, natural language handling, and other AI objectives.

4
votes
1answer
197 views

What loss function to use when labels are probabilities?

What loss function is most appropriate when training a model with target values that are probabilities? For example, I have a 3-output model. I want to train it with a feature vector $x=[x_1, x_2, \...
2
votes
1answer
35 views

Can the normalization factor for the belief state update be zero?

In order to update the belief state in a POMDP, the following formula is used: $$b'(s')=\frac{O(a, s', z) \sum_{s\in S} b(s)T(s, a, s')}{\mathbb{P}(z \mid b, a)}$$ where $s$ is a specific state in ...
1
vote
1answer
36 views

Can we derive the distribution of a random variable based on a dependent random variable's distribution?

In the diagram below, there are three variables: X3 is a function of (depends on) X1 and X2, ...
3
votes
2answers
78 views

Structure in data

Consider some image classification problem. Conceptually, we then have some high dimensional space where all the images can be represented as points, and having large enough labeled data set we can ...
0
votes
1answer
24 views

Is there a mathemtical example for Conditional Random Fields?

I am learning about probabilistic graphical models and I was wondering if there is an example explaining the math behind Conditional random Fields. Looking solely on the formula I have no Idea what we ...
2
votes
0answers
42 views

What kind of distributions can be used to model discrete latent variables?

If we take the vanilla variational auto-encoder (VAE), we $p(z)$ is a Gaussian distribution with zero mean and unit variance and we approximate $p(z|x) \approx q(z|x)$ to be a Gaussian distribution as ...