Questions tagged [optimal-policy]
For questions related to the concept of "optimal policy" in reinforcement learning.
2
questions
2
votes
1answer
60 views
Equation not satisfied in Policy Iteration Algorithm
In equation 4.9 of Sutton and Barto's book on page 79, we have(for policy iteration algo):
$\pi ^{'}(s) = arg \max_{a}\sum_{s',r}p(s',r|s,a)[r+\gamma v_{\pi}(s')]$
where $\pi$ is the previous policy ...
4
votes
1answer
180 views
An example of a unique value function which is associated with multiple optimal policies
In the 4th paragraph of
http://www.incompleteideas.net/book/ebook/node37.html
it is mentioned:
Whereas the optimal value functions for states and state-action pairs are unique for a given MDP, ...
