New answers tagged

1 vote

$E_{\pi}[R_{t+1}|S_t=s,A_t=a] = E[R_{t+1}|S_t=s,A_t=a]$?

Question: Can I write it without the subscript? So $$E_{\pi}[R_{t+1}|S_t=s,A_t=a] = E[R_{t+1}|S_t=s,A_t=a]$$ Yes, your reasoning is sound, there is no need to condition the expectation on the policy, ...
user avatar
  • 23.8k
0 votes

How is the state-visitation frequency computed in "Maximum Entropy Inverse Reinforcement Learning"?

Please look at line 5: If $P(a_{i,j}|s_i)$ is equal to the policy that is used for generating the demonstrated trajectories, then it could be the same. However, in inverse RL you don't know $P(a_{i,j}|...
user avatar

Top 50 recent answers are included