Skip to main content

New answers tagged

0 votes

Would the DDPG algorithm still function effectively if some transitions stored in its replay buffer are generated by a completely unrelated policy?

TLDR: it might work, but it will probably struggle, or not work at all, depending on how optimal your "other" policy is So, strictly theoretically speaking, as long as the behavioral policy ...
Alberto's user avatar
  • 2,273
1 vote
Accepted

Are there problems where the optimal policy is stochastic?

Sutton and Barto give an example of an MDP where the optimal stochastic policy strictly dominates the best deterministic one, should answer all your questions
Alberto's user avatar
  • 2,273
0 votes

Violation of Markov property

Markovian environments contain everything the agent needs to make an optimal decision in the present state. There cannot be a state where an agent passes through it once and the optimal action is one ...
foreverska's user avatar
  • 1,298

Top 50 recent answers are included