As in https://en.wikipedia.org/wiki/Calculus_of_variations

The calculus of variations is a field of mathematical analysis that uses variations, which are small changes in functions and functionals, to find maxima and minima of functionals

The Gradient Descent algorithm is also a method to find minima of a function, it it a part of the Calculus of Variations?

  • 1
    $\begingroup$ We can explain calculus (especially differentiation) to a significant extent using calculus of variations (as per the definition in block quotes is concerned). But I don't think it's much useful after that since we use the $ del $ which is an operator and as such can't be treated like small variations as far as formal maths is concerned. Informally by varying weights by small amount you can still train the network, and produce a good approximation of the output from del operator, albeit be slow and noisy (which may or may not be good). $\endgroup$ – user9947 Feb 4 '20 at 8:07
  • 1
    $\begingroup$ How is this question related to AI? You should at least mention where variational calculus can be used in AI. I know where it can be used, but you should edit your post to make this question more on-topic. $\endgroup$ – nbro Feb 4 '20 at 11:34
  • $\begingroup$ Gradient Descent is AI, and the confusing term here is 'finding minima' $\endgroup$ – datdinhquoc Feb 4 '20 at 17:32
  • $\begingroup$ @datdinhquoc GD alone is not AI. GD is an iterative optimization algorithm, which can also be used in other contexts that someone would not necessarily call AI. I will help you. You could say something like "GD is used to train neural networks and variational calculus is used in computer vision" as a premise, then ask your question. $\endgroup$ – nbro Feb 4 '20 at 22:59
  • $\begingroup$ it's maths, yes, but it's used in AI as the basic optimiser $\endgroup$ – datdinhquoc Feb 5 '20 at 3:15

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.