Neural networks are commonly used for classification tasks, in fact from this post it seems like that's where they shine brightest.

• What is the precise mathematical definition of a classifier.
• When we want to classify using NNs, we just take the last layer to take values in [0,1]? Is this theoretically justified? (ie: is there an analogue to the universal approximation theorem for this case)?