Questions tagged [dyna]

For questions related to the reinforcement learning "dyna" architecture.

Filter by
Sorted by
Tagged with
1
vote
0answers
20 views

Why does the Dyna-Q+ algorithm converge?

I can't understand why Dyna-Q+ algorithm converges, it only gives extra reward for visiting sates that were visited long before, but how does the agent know that the particular state is visited long ...
0
votes
1answer
20 views

How is trajectory sampling different than normal (importance) sampling in reinforcement learning?

I am using Sutton and Barto's book for Reinforcement Learning. In Chapter 8, I am having difficulty in understanding the Trajectory Sampling. I have read the particular section on trajectory sampling (...
1
vote
0answers
40 views

How do I know if the assumption of a static environment is made?

An important property of a reinforcement learning problem is whether the environment of the agent is static, which means that nothing changes if the agent remains inactive. Different learning methods ...
2
votes
0answers
57 views

Eligibility trace In Model-based Reinforcement Learning

In model-based reinforcement learning algorithms, the model of the environment is constructed to efficiently use samples, models such as Dyna, and Prioritize Sweeping. Moreover, eligibility trace ...