Skip to main content
Share Your Experience: Take the 2024 Developer Survey

New answers tagged

10 votes
Accepted

When to use Tanh?

Using tanh in hidden layers require careful initialization of network weights and works best with the input features normalized within the same range as output (i.e. -1 to 1). It have expensive ...
Leo's user avatar
  • 425
1 vote
Accepted

Xavier vs He initialization with tanh

Xavier (or Glorot) initialization is designed to prevent both sigmoid and tanh activations to saturate, i.e., to yield values ...
Luca Anzalone's user avatar

Top 50 recent answers are included