Questions tagged [afterstate-value-functions]

For questions about the concept of a "afterstate value function", as informally defined in section 6.8 of Sutton and Barto's book (2nd edition). Afterstates are also known as "post-decision states" in the literature.

Filter by
Sorted by
Tagged with
4
votes
1answer
121 views

How are afterstate value functions mathematically defined?

In this answer, afterstate value functions are mentioned, and that temporal-difference (TD) and Monte Carlo (MC) methods can also use these value functions. Mathematically, how are these value ...