I'm trying to understand the DDPG algorithm shown at this page. I don't know what should the result of the gradient at step 14 be.
Is it a scalar that I have to use to update all the weights (so all weights are updated with the same value)? Or is it a list with a different values to use for updating for each weight? I'm used to working with loss functions and an $y$ target, but here I don't have them so I'm quite confused.