Questions tagged [random-variable]

For questions related to the mathematical concept of a random variable (in the context of AI).

Filter by
Sorted by
Tagged with
0 votes
0 answers
15 views

Trouble understanding Variational Inference objective

I was reading the Meta Temporal Point Processes paper and was having trouble understading the training objective presented. The authors state that it is the ELBO used in Variational Inference ...
YEp d's user avatar
  • 1
1 vote
1 answer
57 views

How to compute an estimate of the expected value of a stochastic random variable in Reinforcement Learning?

In the section on LSTD in SuttonBarto's book on RL, there is a proof on convergence of semi-gradient TD(0) using a linear function approximator. Later on they estimated A and b as I was under the ...
user75923's user avatar
0 votes
1 answer
68 views

What should be taken as random variables in the distributions of datasets?

Consider the following two paragraphs taken from the paper titles Generative Adversarial Nets by Ian J. Goodfellow et.al #1: Abstract We propose a new framework for estimating generative models via ...
hanugm's user avatar
  • 3,612
0 votes
1 answer
359 views

Is there any advantage in viewing weights of a neural network as random variables?

In artificial intelligence, especially in machine learning, the inputs and outputs of neurons in a neural network can be viewed as random variables. And this view is highly useful in many ways. The ...
hanugm's user avatar
  • 3,612
0 votes
1 answer
230 views

For the VAE, should the input, output and latent variable code be random variables?

For a variational autoencoder, we have input $x$ (assume 1 data point for now, like an image), a latent code sampled from the decoder, $z$, and an output $\hat{x}$. If I were to draw a diagram for the ...
a12345's user avatar
  • 213
0 votes
1 answer
473 views

When can we call a feature "hierarchical"?

Features in machine learning are the attributes of the elements of a data set. They are considered as random variables in probability. Consider the following excerpt from 1.1: The deep learning ...
hanugm's user avatar
  • 3,612
0 votes
0 answers
95 views

What are the different possible usages of the word "i.i.d" in machine learning?

The acronym "iid" stands for "independent and identically distributed". It is a property of a sequence of random variables. You can read here for more details. This question is ...
hanugm's user avatar
  • 3,612
0 votes
2 answers
86 views

Is knowing underlying probability distribution mandatory for deciding iid property of random variables?

Consider the following information regarding iid random variables The acronym IID stands for "Independent and Identically Distributed". A sequence of random variables (or random vectors) is ...
hanugm's user avatar
  • 3,612
2 votes
1 answer
124 views

Which of the following probability distribution is generating an iid dataset?

Let $X_1, X_2$ be two discrete random variables. Each random variable takes two values: $1, 2$ The probability distribution $p_1$ over $X_1, X_2$ is given by $$p_1(X_1=1, X_2 = 1) = \dfrac{1}{4}$$ $$...
hanugm's user avatar
  • 3,612
1 vote
1 answer
327 views

Can I always interpret features as random variables in machine learning safely?

Consider the following statements from Chapter 5: Machine Learning Basics from the book titled Deep Learning (by Aaron Courville et al.) Machine learning tasks are usually described in terms of how ...
hanugm's user avatar
  • 3,612
1 vote
1 answer
122 views

What are the iid random variables for a dataset in the GAN framework?

I am trying to understand why mean is used for expectation in training Generative Adversarial Networks. The answer tells that it is due to the law of large numbers which is based on the assumption ...
hanugm's user avatar
  • 3,612
1 vote
1 answer
305 views

Is it abuse of notation to use tilde operator in this context?

The following is a way to use tilde (∼) in context of random variables or random vectors. In statistics, the tilde is frequently used to mean "has the distribution (of)," for instance, $X∼N(...
hanugm's user avatar
  • 3,612
1 vote
0 answers
23 views

Is it possible to use (infinite cardinal) random variables during implementation?

Random variables can be broadly classified into three types: random variables whose range is finite, random variable whose range is countably infinite and random variables whose range is uncountable. ...
hanugm's user avatar
  • 3,612
1 vote
0 answers
32 views

What machine learning model should I use for a random dice-based game?

Consider a game like Pig (https://en.wikipedia.org/wiki/Pig_(dice_game)), but with a few additions: namely functions of both player's score and turn number that have unique impacts on scoring. What ...
robert's user avatar
  • 111
1 vote
1 answer
347 views

In the definition of the state-action value function, what is the random variable we take the expectation of?

I know that $$\mathbb{E}[g(X) \mid A] = \sum\limits_{x} g(x) p_{X \mid A}(x)$$ for any random variable $X$. Now, consider the following expression. $$\mathbb{E}_{\pi} \left[ \sum \limits_{k=0}^{\infty}...
hanugm's user avatar
  • 3,612
5 votes
1 answer
854 views

What does the notation $\mathcal{N}(z; \mu, \sigma)$ stand for in statistics?

I know that the notation $\mathcal{N}(\mu, \sigma)$ stands for a normal distribution. But I'm reading the book "An Introduction to Variational Autoencoders" and in it, there is this notation:...
Peyman's user avatar
  • 554
1 vote
1 answer
50 views

Why is this variable in equation 2 of the SQAIR paper a random vector of $n$ ones followed by a zero?

I've been reading the SQAIR paper lately, and the mathematics involved seems a bit complicated. Some background, about the paper: SQAIR stands for Sequential Attend, Infer, Repeat - the paper does ...
stoic-santiago's user avatar
0 votes
1 answer
897 views

Should the biases be zero or randomly initialised?

I'm initialising DNN of shape [2 inputs, 2 hiddens, 1 output] with these weights and biases: ...
Dan D.'s user avatar
  • 1,283
1 vote
0 answers
76 views

What is the point of converting conditional probability to factor for Variable Elimination?

I have this slide from my AI class on using a Bayes network to compute a conditional probability. I don't really understand the point of converting the conditional probabilities to factors (besides ...
Gooby's user avatar
  • 351
3 votes
1 answer
174 views

Is learning possible without random thoughts and actions?

In my view intelligence begins once the thoughts/actions are logical rather than purely randomn based. The learning environments can be random but the logic seems to obey some elusive rules. There is ...
dankilev's user avatar
  • 143
1 vote
0 answers
65 views

What kind of distributions can be used to model discrete latent variables?

If we take the vanilla variational auto-encoder (VAE), we $p(z)$ is a Gaussian distribution with zero mean and unit variance and we approximate $p(z|x) \approx q(z|x)$ to be a Gaussian distribution as ...
piccolo's user avatar
  • 173