New answers tagged proofs
2
The policy gradient states that
$$\nabla J(\theta) \propto \sum_s \mu(s) \sum_a q_\pi(s, a) \nabla\pi(a | s; \theta)\;$$
where the derivatives are taken wrt the parameter $\theta$.
Now, if we say incorporate a baseline we get
$$\nabla J(\theta) \propto \sum_s \mu(s) \sum_a \left( q_\pi(s, a) - b(s) \right)\nabla\pi(a | s; \theta)\;$$
and this does not effect ...
Top 50 recent answers are included
