4
$\begingroup$

I just read that OpenAI's ES uses Adam: "OpenAI’s ES is denoted as “OptimES” (since it uses Adam optimizer)"?? I verified they are correct using the link they posted, (see es_distributed/Optimizers.py). But I don't understand how because the paper says they are using Evolution Strategies as a Scalable Alternative to Reinforcement Learning, which is black box optimization (like most ES's)... So how on earth is Adam used, given this is black box?

Improve this question
$\endgroup$

1 Answer 1

Reset to default
0
$\begingroup$

OpenAI's ES updates parameters using learning rate. It may remain constant, decaying or changed in different ways. You can for example use momentum that's commonly used in stochastic gradient descent. So Adam is used to adjust learning rates per parameters.

Improve this answer
$\endgroup$
2
  • $\begingroup$ Oh that's interesting. Just checking though you're sure about this? Could you add some citations? $\endgroup$
    – profPlum
    Commented May 12, 2022 at 17:38
  • 1
    $\begingroup$ Not citations per se, but look at the code in github from Visual Guide to Evolution Strategies. $\endgroup$
    – derjack
    Commented May 12, 2022 at 18:53

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .