Questions tagged [calculus]

For questions related to calculus (developed, among others, by Newton and Leibniz), in the context of AI (and, in particular, machine learning).

Filter by
Sorted by
Tagged with
2
votes
1answer
56 views

How is the log-derivative trick of a trajectory derived?

I am looking at this formula which breaks down the gradient of $P(\tau |\theta)$ the first part is clear as is the derivative of $\log(x)$, but I do not see how the first formula is rearranged into ...
2
votes
0answers
25 views

Is there any wrong in my focal loss derivation?

Assume $\mathbf{X} \in R^{N, C}$ is the input of the softmax $\mathbf{P} \in R^{N, C}$, where $N$ is number of examples and $C$ is number of classes: $$\mathbf{p}_i = \left[ \frac{e^{x_{ik}}}{\sum_{j=...
1
vote
0answers
43 views

Is Gradient Descent algorithm a part of Calculus of Variations?

As in https://en.wikipedia.org/wiki/Calculus_of_variations The calculus of variations is a field of mathematical analysis that uses variations, which are small changes in functions and ...
3
votes
2answers
768 views

What is a bad local minimum in machine learning?

What is "bad local minima"? The following papers all mention this expression. Eliminating all bad Local Minima from Loss Landscapes without even adding an Extra Unit limination of All Bad Local ...