Skip to main content

Questions tagged [leaky-relu]

For questions about the Leaky ReLU activation function, which can be used in neural networks.

Filter by
Sorted by
Tagged with
2 votes
2 answers
1k views

How do we determine the slope for leakyrelu activation function?

I am using LeakyReLU activation function in my architecture. We know that the default slope value is 1e-2. I want to understand ...
Rohit Singh's user avatar
1 vote
0 answers
140 views

What are the benefits of using ELU over other activation functions in CNNs?

I have come up with some examples of CNNs (segmentation CNNs) that use ELU (exponential linear unit) as an activation function. What are the benefits of this activation function over others, such as ...
IgnacioGaBo's user avatar