Questions tagged [gradient]
For questions related to the gradient, a way of packing together all the partial derivative information of a function
3
questions
2
votes
1answer
47 views
What is $ \nabla_{\theta_{k-1}} \theta_{k}$ in the context of MAML?
I am attempting to fully understand the explicit derivation and computation of the Hessian and how it is used in MAML. I came across this blog: https://lilianweng.github.io/lil-log/2018/11/30/meta-...
0
votes
0answers
22 views
During Backpropagation in LSTM, why is the previous output $h_{t-1}$ considered constant w.r.t any $W$ while computing derivative?
I've just started learning LSTM, and some points in the process of calculating the gradients are getting me confused.
Say, for example, we want to compute $\frac{\partial}{\partial W_i}L$, where $L$ ...
4
votes
1answer
756 views
How is the gradient of the loss function in DQN derived?
In the original DQN paper, page 1, the loss function of the DQN is
$$
L_{i}(\theta_{i}) = \mathbb{E}_{(s,a,r,s') \sim U(D)} [(r+\gamma \max_{a'} Q(s',a',\theta_{i}^{-}) - Q(s,a;\theta_{i}))^2]
$$
...
