Skip to main content
Search type Search syntax
Tags [tag]
Exact "words here"
Author user:1234
user:me (yours)
Score score:3 (3+)
score:0 (none)
Answers answers:3 (3+)
answers:0 (none)
isaccepted:yes
hasaccepted:no
inquestion:1234
Views views:250
Code code:"if (foo != bar)"
Sections title:apples
body:"apples oranges"
URL url:"*.example.com"
Saves in:saves
Status closed:yes
duplicate:no
migrated:no
wiki:no
Types is:question
is:answer
Exclude -[tag]
-apples
For more details on advanced search visit our help page
Results tagged with
Search options questions only not deleted user 46718

Use this tag for questions related to "hyperbolic tangent activation functions" (tanh) used in neural networks.

3 votes
3 answers
5k views

Why is there tanh(x)*sigmoid(x) in a LSTM cell?

My intuition was based on the flow of tanh(x)*sigmoid(x) and the derivative of tanh(x)*sigmoid(x) It seems to me that authors wanted to choose such a combination of functions, the derivative would make … Why there are tanh(x)*sigmoid(x) signals in the input and output gate? …
MASTER OF CODE's user avatar