Questions tagged [on-policy-methods]
For questions related to the "on-policy" reinforcement learning algorithms.
4
questions
4
votes
1answer
498 views
Is Expected SARSA an off-policy or on-policy algorithm?
I understand that SARSA is an On-policy algorithm, and Q-learning an off-policy one.
Sutton and Barto's textbook describes Expected Sarsa thusly:
In these cliff walking results Expected Sarsa was ...
2
votes
1answer
51 views
Could we update the policy network with previous trajectories using supervised learning?
I believe to understand the reason why on-policy methods cannot reuse trajectories collected from earlier policies: the trajectory distribution change with the policy and the policy gradient is ...
4
votes
1answer
2k views
What is the relation between online (or offline) learning and on-policy (or off-policy) algorithms?
In the context of RL, there is the notion of on-policy and off-policy algorithms. I understand the difference between on-policy and off-policy algorithms. Moreover, in RL, there's also the notion of ...
4
votes
1answer
1k views
Why is GLIE Monte-Carlo control an on-policy control?
In slide 16 of his lecture 5 of the course "Reinforcement Learning", David Silver introduced GLIE Monte-Carlo Control.
But why is it an on-policy control? The sampling follows a policy $\pi$ while ...
