Questions tagged [iid]

For questions about the concept of independent and identically distributed (often shortened as i.i.d., iid or IID) random variables (or samples) and assumption, which is often made in statistics and machine learning.

Filter by
Sorted by
Tagged with
15 votes
3 answers
7k views

Why exactly do neural networks require i.i.d. data?

In reinforcement learning, successive states (actions and rewards) can be correlated. An experience replay buffer was used, in the DQN architecture, to avoid training the neural network (NN), which ...
nbro's user avatar
  • 40.5k
2 votes
1 answer
139 views

Which of the following probability distribution is generating an iid dataset?

Let $X_1, X_2$ be two discrete random variables. Each random variable takes two values: $1, 2$ The probability distribution $p_1$ over $X_1, X_2$ is given by $$p_1(X_1=1, X_2 = 1) = \dfrac{1}{4}$$ $$...
hanugm's user avatar
  • 3,840
1 vote
1 answer
133 views

What are the iid random variables for a dataset in the GAN framework?

I am trying to understand why mean is used for expectation in training Generative Adversarial Networks. The answer tells that it is due to the law of large numbers which is based on the assumption ...
hanugm's user avatar
  • 3,840
1 vote
2 answers
403 views

How can we "draw i.i.d" from any probability distribution?

Consider the following paragraph from 2 Learning in High Dimensions in from of the paper titled Geometric Deep Learning Grids, Groups, Graphs, Geodesics, and Gauges ...
hanugm's user avatar
  • 3,840
0 votes
2 answers
88 views

Is knowing underlying probability distribution mandatory for deciding iid property of random variables?

Consider the following information regarding iid random variables The acronym IID stands for "Independent and Identically Distributed". A sequence of random variables (or random vectors) is ...
hanugm's user avatar
  • 3,840