New answers tagged


They have a few similarities, but they are quite different. Let me first give you a general description of both approaches/algorithms, so that you start to get a sense of their differences and similarities. Description Gradient descent (GD) can be applied to solving any optimization problem where your loss (aka cost or objective) function is differentiable ...

Top 50 recent answers are included