In looking at an algorithm in the paper Learning to Communicate with Deep Multi-Agent Reinforcement Learning.
Here is the full algorithm:
What does the notation for t=T to 1,−1 do:
refer to in terms of time steps?
The network structure is a deep recurrent q network.
Secondly, why do the gradients need to be reset to zero?