3 votes
Accepted

What is numerical stability?

You can find a definition for "numerical stability" in mathworld wolframe: Numerical stability refers to how a malformed input affects the execution of an algorithm. In a numerically stable ...
user avatar
  • 1,663
3 votes
Accepted

Why is second-order backpropagation useful?

Second-order optimization algorithms like Hessian optimization have more information on the curvature of the loss function, so converge much, much faster than first-order optimization algorithms like ...
user avatar
  • 1,230
2 votes

Is there any domain in machine learning that solves a problem by using only analytical algorithms?

In some cases, you can solve a linear regression problem with an analytical (or closed-form) solution/expression (although this may not always be the best approach). See this answer for more details. ...
user avatar
  • 33.8k
1 vote

Is there any domain in machine learning that solves a problem by using only analytical algorithms?

Honourable mention: Memory-based approaches Although not analytic, memory-based models, such as k-nearest neighbours (k-NN) are very lightweight when learning, but have a higher cost to use the stored ...
user avatar
  • 23.8k

Only top scored, non community-wiki answers of a minimum length are eligible