New answers tagged

1 vote

Replay buffer action range in DDPG

It has an obvious answer: Network is conditioned to use tanh activation. Hence the buffer should be [-1, 1], or unscaled values before action execution. As I am not using openai gym or other baselines ...
user avatar
0 votes

How do we estimate the value of a stochastic policy?

We are choosing actions randomly with probabilities given by the policy $\pi$. For example, one policy might make two actions A and B equally likely, another might choose A 90% of the time. What we're ...
user avatar
1 vote
Accepted

How to implement PPO without using a Critic

Your justification for not wanting to use a critic (that the episodes are short) does not make sense to me. I would expect that including the critic would result in a substantial variance reduction (...
user avatar
  • 876

Top 50 recent answers are included