# Questions tagged [double-q-learning]

For questions related to the (tabular) version of the double Q-learning algorithm, which was introduced in "Double Q-learning" (2010, NeurIPS) by Hado Hasselt.

8 questions
Filter by
Sorted by
Tagged with
37 views

### What are the update equations for Double Expected Sarsa with an $\epsilon$-greedy target policy?

This is question 6.13 in Sutton-Barto,page 136. What are the update equations for Double Expected Sarsa with an $\epsilon$-greedy target policy? The answer is given as follows: Let $Q_1$ and $Q_2$ ...
• 833
26 views

### how to choose the reward function to solve an optimization problem with DQN

I am currently working on solving an optimization problem related to the facilities layout using Deep Q-Networks (DQN). The primary challenge I am facing revolves around designing an effective reward ...
1 vote
89 views

### Q learning achieves small reward in simple dice game

I am trying to train a Q learning agent on the following game: The states are parametrised by an integer $S \geq 0$ (representing the sum of the previous die rolls). In each step the player can choose ...
• 111
136 views

### Does "number of actions" refer to the number of actions taken or size of the action space?

In the original DDQN article (https://arxiv.org/pdf/1509.06461.pdf,) the phrase "number of actions" is used twice; First, in the following context: Secondly in Theorem 1. I have a hard ...
197 views

### How to embed game grid state with walls as an input to neural network

I've read most of the posts on here regarding this subject, however most of them deal with gameboards where there are two different categories of single pieces on a board without walls etc. My game ...
4k views

### Deep Q-Learning "catastrophic drop" reasons?

I am implementing some "classical" papers in Model Free RL like DQN, Double DQN, and Double DQN with Prioritized Replay. Through the various models im running on ...
• 81