Questions tagged [elu]

For questions about the Exponential Linear Unit (ELU) activation function that can be used in neural networks.

Filter by
Sorted by
Tagged with
1
vote
0answers
45 views

What are the benefits of using ELU over other activation functions in CNNs?

I have come up with some examples of CNNs (segmentation CNNs) that use ELU (exponential linear unit) as an activation function. What are the benefits of this activation function over others, such as ...
1
vote
1answer
83 views

Why don't ELUs multiply the linear portion by $\alpha$?

An exponential linear unit (as proposed by Clevert et al.) uses the function: \begin{align} \text{ELU}_\alpha(x) = \begin{cases} \alpha(e^x - 1), &\text{if } x < 0\\ x, \text{if} &\text{if ...