Can I treat a stochastic policy (over a finite action space of size $n$) as a deterministic policy (in the set of probability distribution in $\mathbb{R}^n$)?

It seems to me that nothing is broken by making this mental translation, except that the "induced environment" now has to take a stochastic action and spit out the next state, which is not hard using on the original environment. Is this legit? If yes, how does this "deterministify then DDPG" approach compare to, for example, A2C?

  • $\begingroup$ Can you clarify what you mean by "treat"? This question is unclear to me. $\endgroup$ Apr 5 '19 at 6:47

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.