All Questions
Tagged with model-free-methods pseudocode
1 question
0
votes
1
answer
146
views
Why don't we bootstrap terminal state in n-step temporal difference prediction update equation?
In the algorithm below, when $\tau + n \geq T$, shouldn't the algorithm bootstrap with the value of the next state? For instance, when $T=5, \tau=3, \& \; n=2$, we don't bootstrap the sample ...
- 379