Questions tagged [gradient-methods]

For questions about gradient methods (or gradient-based algorithms) in the context of Artificial Intelligence. Examples of gradient methods are gradient descent/ascent, conjugate gradient or policy gradients.

Filter by
Sorted by
Tagged with
0 votes
0 answers
17 views

Which NLP methods use gradient and activation methods?

I am doing a literature review of gradient-based methods for NLP. Yet, apart from linear and logistic regression, I have little knowledge of other methods using the gradient. So, I have no knowledge ...
user avatar
1 vote
0 answers
10 views

References for the convergence of gradient-based algorithms for training neural networks

I'm looking for some good references that give convergence results of training neural networks. I'm decently familiar with works that analyze the convergence of SGD, and, in particular, I really like ...
user avatar
  • 876