In training a neural network, you often see the curve showing how fast the neural network is getting better. It usually grows very fast then slows down to almost horizontal.
Is there a mathematical formula that matches these curves?
Some similar curves are:
Is there a theoretical reason for this shape?