# Is it a great misconception that the softmax is an activation function?

An activation function is a function from $$R \rightarrow R$$. It takes as input the inner products of weights and activations in the previous layer. It outputs the activation.

A softmax however, is a function that takes input from $$R^p$$, where $$p$$ is the number of possible outcomes that need to be classified. Therefore, strictly speaking, it cannot be an activation function.

Yet everywhere on the net it says the softmax is an activation function. Am I wrong or are they?

• An activation function isn't necessarily defined as $\mathbb{R} \rightarrow \mathbb{R}$. – nbro Feb 13 at 11:56
• I would be interested to know where you are taking your definition of an activation function from in your first paragraph? I am not sure if it has a formal definition, and even if it did, this would maybe become an issue of mis-naming or mis-classifying something, but the engineering of it - what it is and does - would remain exactly the same. – Neil Slater Feb 13 at 14:27
• Coming to think of it, I did not see a formal definition. Instead, I saw pictures such as those link, where it seems that they are functions that take from & $\mathbb{R}$. – TimvanSch Feb 22 at 11:09