0
$\begingroup$

In the caption of figure 7.4 (p. 147) of Sutton & Barto's book (2nd edition), it's written

The one-step method strengthens only the last action of the sequence of actions that led to the high reward, whereas the n-step method strengthens the last n actions of the sequence, so that much more is learned from the one episode.

Why does one-step TD strengthen only the last action of the sequence of actions that led to the high reward, while n-step TD the last n actions?

Here's a screenshot of the figure.

enter image description here

Improve this question
$\endgroup$
2
  • 1
    $\begingroup$ Please provide a link if possible. $\endgroup$
    – hanugm
    Commented Aug 18, 2021 at 22:42
  • $\begingroup$ I've edited your post to include the link to the book and to clarify your question, but, please, next time, provide more details. In particular, you should explain what you don't understand, and what is your background in RL. Feel free to edit your post to add more details. $\endgroup$
    – nbro
    Commented Aug 19, 2021 at 13:03

0

Reset to default

You must log in to answer this question.