1 vote
Accepted

How to implement PPO without using a Critic

Your justification for not wanting to use a critic (that the episodes are short) does not make sense to me. I would expect that including the critic would result in a substantial variance reduction (...
user avatar
  • 876
1 vote

Replay buffer action range in DDPG

It has an obvious answer: Network is conditioned to use tanh activation. Hence the buffer should be [-1, 1], or unscaled values before action execution. As I am not using openai gym or other baselines ...
user avatar

Only top scored, non community-wiki answers of a minimum length are eligible