Skip to main content
Search type Search syntax
Tags [tag]
Exact "words here"
Author user:1234
user:me (yours)
Score score:3 (3+)
score:0 (none)
Answers answers:3 (3+)
answers:0 (none)
isaccepted:yes
hasaccepted:no
inquestion:1234
Views views:250
Code code:"if (foo != bar)"
Sections title:apples
body:"apples oranges"
URL url:"*.example.com"
Saves in:saves
Status closed:yes
duplicate:no
migrated:no
wiki:no
Types is:question
is:answer
Exclude -[tag]
-apples
For more details on advanced search visit our help page
Results tagged with
Search options not deleted user 85497

For questions related to the selection of and theory behind specific activation functions used in artificial networks.

3 votes
2 answers
497 views

Why aren't activation functions variable as well instead of being fixed?

For each layer, we could define a vector of activation functions like: $$\begin{bmatrix} f(x) \\ f(x) \\ f(x) \\ \vdots \end{bmatrix}$$ and then have that be applied on the neurons of each layer. If w …
hansoko's user avatar
  • 173