1
$\begingroup$

I have heard that sigmoid activation functions should not be used on neural networks with many hidden layers as the gradients tend to vanish in deep networks.

When should each of the common activation functions be used, and why?

  • ReLu
  • Sigmoid
  • Softmax
  • Leaky ReLu
  • TanH
$\endgroup$
1

0

You must log in to answer this question.