# Tag Info

This is the case as the loss doesn't have to monotonically decrease when it's updated in the negative direction. For example: Let $L(\theta) = \theta^2$ and $\theta_0= 3$ Let the subscript n in \$\...