1
$\begingroup$

Are there rules of thumb as to which activation functions work well (or which one would not) on the policy and value network of a class of RL algorithms? For hidden layers and for the output layer.

For example, I came across [1], which mentions ELU to be indispensable to MPO [2], and tanh (output activation) to be indispensable to SAC's Gaussian policy.

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.