New answers tagged activation-functions
1
vote
Why is it important/beneficial for an activation function to be zero-meaned?
The first part of this answer is regarding your concrete question and the second part summarizes things on activation functions in general because I believe that there are more important factors than ...
0
votes
Accepted
Should the range of target values match the range of activation function used in the output layer?
Yes, you should use an activation function that match the range of your ground truth labels, or the other way around, i.e. apply a normalization function to the labels to match your activation ...
0
votes
Should the range of target values match the range of activation function used in the output layer?
If you have already trained your model to predict either -1 or 1, and now your target variable is either 0 or 1, if -1 predicted by your model is the same as 0 in your target variable, then there are ...
Top 50 recent answers are included
Related Tags
activation-functions × 148neural-networks × 95
deep-learning × 40
machine-learning × 22
relu × 18
convolutional-neural-networks × 11
objective-functions × 11
sigmoid × 11
math × 10
perceptron × 9
reinforcement-learning × 8
terminology × 7
backpropagation × 7
regression × 7
function-approximation × 7
artificial-neuron × 7
comparison × 6
deep-neural-networks × 6
hyper-parameters × 6
classification × 5
hidden-layers × 5
network-design × 5
tensorflow × 4
definitions × 4
gradient-descent × 4