New answers tagged actor-critic-methods
1
vote
Replay buffer action range in DDPG
It has an obvious answer: Network is conditioned to use tanh activation. Hence the buffer should be [-1, 1], or unscaled values before action execution. As I am not using openai gym or other baselines ...
- 13
0
votes
How do we estimate the value of a stochastic policy?
We are choosing actions randomly with probabilities given by the policy $\pi$. For example, one policy might make two actions A and B equally likely, another might choose A 90% of the time.
What we're ...
- 451
1
vote
Accepted
How to implement PPO without using a Critic
Your justification for not wanting to use a critic (that the episodes are short) does not make sense to me. I would expect that including the critic would result in a substantial variance reduction (...
- 876
Top 50 recent answers are included