Questions tagged [expected-sarsa]

For questions related to the reinforcement learning algorithm called "expected SARSA" (as described in the book "Reinforcement Learning: An Introduction", by Sutton and Barto, 2nd edition).

Filter by
Sorted by
Tagged with
0
votes
0answers
12 views

Why is expected sarsa algorithm an off-policy learning? [duplicate]

I am not able to understand why expected sarsa algorithm is an off-policy learning method? How is it that behaviour and target policies can be different? Also please tell under what situation and ...
3
votes
1answer
130 views

Is Expected SARSA an off-policy or on-policy algorithm?

I understand that SARSA is an On-policy algorithm, and Q-learning an off-policy one. Sutton and Barto's textbook describes Expected Sarsa thusly: In these cliff walking results Expected Sarsa was ...
1
vote
0answers
115 views

Expected SARSA, SARSA and Q-learning

I would much appreciate if you could point me in the right direction regarding this question about targets for approximate ...
4
votes
1answer
2k views

Expected SARSA vs SARSA in “RL: An Introduction”

Sutton and Barto state in the 2018-version of "Reinforcement Learning: An Introduction" in the context of Expected SARSA (p. 133) the following sentences: Expected SARSA is more complex ...