Skip to main content

Questions tagged [tanh]

Use this tag for questions related to "hyperbolic tangent activation functions" (tanh) used in neural networks.

Filter by
Sorted by
Tagged with
3 votes
1 answer
1k views

Why is tanh a "smoothly" differentiable function?

The sigmoid, tanh, and ReLU are popular and useful activation functions in the literature. The following excerpt taken from p4 of Neural Networks and Neural Language Models says that ...
hanugm's user avatar
  • 3,990