Questions tagged [variance-reduction]
For questions about variance reduction techniques in the context of artificial intelligence, in particular, sampling or Monte Carlo methods. An example of a variance reduction technique is Flipout, which was proposed in the paper "Flipout: Efficient Pseudo-Independent Weight Perturbations on Mini-Batches" (2018) by Yeming Wen et al.
4
questions
1
vote
0
answers
46
views
Can PPO be applied when the environment is "input-driven"?
I'm reimplementing an RL paper about learning a job scheduling policy that acts so as to minimize average job completion time. They claim that this is an "input-driven" problem, i.e. much of ...
- 121
0
votes
1
answer
33
views
How to reduce variance in F1 scores of GAT across multiple runs while using PU Loss?
I am training GAT using a custom loss function(PU Loss) on the Cora and Citeseer dataset. My training file looks like
...
- 35
1
vote
0
answers
65
views
What strategies are there to reduce the variance of the policy gradient estimator of the REINFORCE algorithm?
What strategies are there to reduce the variance of the policy gradient estimator of the REINFORCE algorithm?
I know one possibility is to subtract a baseline as a running average of rewards from past ...
14
votes
3
answers
12k
views
Why does is make sense to normalize rewards per episode in reinforcement learning?
In Open AI's actor-critic and in Open AI's REINFORCE, the rewards are being normalized like so
rewards = (rewards - rewards.mean()) / (rewards.std() + eps)
on ...
- 729