3
$\begingroup$

In the paper Deep Recurrent Q-Learning for Partially Observable MDPs, the DRQN is described as DQN with the first post-convolutional fully-connected layer replaced by a recurrent LSTM.

I have DQN implementation with only two dense layers. I want to change this into DRQN with the first layer as an LSTM and leave the second dense layer untouched. If I understood correctly, I would also need to change the input data appropriately.

Are there any other things that need to be modified in order to make DRQN work?

Improve this question
$\endgroup$
2
  • $\begingroup$ Maybe your network cannot be considered the same as (or equivalent to) the DRQN if you also don't have the convolutional layers, even though the convolutional layers were mainly needed in the DQN paper because the input were images. Yours will be a network with a recurrent layer followed by a dense layer. What is the type of your input? Anyway, the Q part in DQN and DRQN only refers to the Q-learning algorithm. We could have called these networks simply deep networks or CNNs or RNNs. We just use the letter Q in order to contextualise the usage of these networks, which have nothing special. $\endgroup$
    – nbro
    Commented Apr 9, 2019 at 17:18
  • $\begingroup$ Thanks for the clarification. I did not realize DRQN is a general term for a deep network with some recurrent layer and uses Q-learning. I thought it referred to the specific implementation. $\endgroup$
    – Savco
    Commented Apr 10, 2019 at 8:32

0

Reset to default

You must log in to answer this question.