Skip to main content
Share Your Experience: Take the 2024 Developer Survey
1 vote
Accepted

In reinforcement learning policy evaluation, which reward is received?

The reward likely should be based on the dynamics of the environment not the intention of the agent. Imagine if $r_2$ was a large negative reward and $p_2 > p_1$. This should be captured in the ...
foreverska's user avatar
  • 1,263
1 vote
Accepted

Can Q(s,a) be replaced by V(s) when certrain requirements are met?

Your criteria #4: It is possible to enumerate all next states $s'$ for a given state $s$. makes me think you are describing afterstate representation. Yes, you can really ignore actions for model-...
Neil Slater's user avatar
  • 32.4k
1 vote

How do we get the optimal value-function?

Bellman Expectation Equations Let's first look at the definition of the value functions. The state-value function $V^\pi(s_t)$ is defined as the expected return $G_t=\sum_{t'=t} \gamma^{t-t'} r_{t'}$ ...
Luca Anzalone's user avatar
1 vote

Why must the value of a state under an optimal policy equal the expected return for the best action from that state?

I was also confused when Sutton and Barto claimed in chapter 3, as you stated, that the value of a state under an optimal policy must equal the expected return for the best action from that state. ...
AMT's user avatar
  • 111

Only top scored, non community-wiki answers of a minimum length are eligible