1
$\begingroup$

Why is Acme using own initializer for both tanh and ELU, when commonly used for tanh is Xavier and for ELU is He initializer? What mathematics is behind them?

Here is the code.

uniform_initializer = tf.initializers.VarianceScaling(
    distribution='uniform', mode='fan_out', scale=0.333)
Improve this question
$\endgroup$

0

Reset to default

You must log in to answer this question.