Questions tagged [double-q-learning]

For questions related to the (tabular) version of the double Q-learning algorithm, which was introduced in "Double Q-learning" (2010, NeurIPS) by Hado Hasselt.

Filter by
Sorted by
Tagged with
4
votes
1answer
79 views

Deep Q-Learning “catastrophic drop” reasons?

I am implementing some "classical" papers in Model Free RL like DQN, Double DQN, and Double DQN with Prioritized Replay. Through the various models im running on ...
3
votes
1answer
269 views

Why does regular Q-learning (and DQN) overestimate the Q values?

The motivation for the introduction of double DQN (and double Q-learning) is that the regular Q-learning (or DQN) can overestimate the Q value, but is there a brief explanation as to why it is ...
0
votes
0answers
57 views

Is there any toy example that can exemplify the performance of double Q-learning?

I recently tried to reproduce the results of double Q-learning. However, the results are not satisfying. I have also tried to compare double Q learning with Q-learning in Taxi-v3, FrozenLake without ...