Questions tagged [dyna]
For questions related to the reinforcement learning "dyna" architecture.
5
questions
0
votes
0answers
26 views
How DynaQ behaves in stochastic world in comparison with other reinforcement learning algorithms?
I came across of implementations of a bunch of algorithms on stochastic windy gridworld. This is the graph comparing their performance:
So clearly, it seems that DynaQ performs better than all other ...
1
vote
1answer
69 views
If $\alpha$ decreases over time, why is Q-learning guaranteed to converge?
Q-Learning is guaranteed to converge if $\alpha$ decreases over time.
On page 161 of the RL book by Sutton and Barto, 2nd edition, section 8.1, they write that Dyna-Q is guaranteed to converge if each ...
1
vote
1answer
54 views
How is trajectory sampling different than normal (importance) sampling in reinforcement learning?
I am using Sutton and Barto's book for Reinforcement Learning.
In Chapter 8, I am having difficulty in understanding the Trajectory Sampling.
I have read the particular section on trajectory sampling (...
1
vote
0answers
81 views
How do I know if the assumption of a static environment is made?
An important property of a reinforcement learning problem is whether the environment of the agent is static, which means that nothing changes if the agent remains inactive. Different learning methods ...
2
votes
0answers
72 views
Eligibility trace In Model-based Reinforcement Learning
In model-based reinforcement learning algorithms, the model of the environment is constructed to efficiently use samples, models such as Dyna, and Prioritize Sweeping. Moreover, eligibility trace ...
