I am new to Reinforcement Learning. I have been working on a problem using Deep Deterministic Policy Gradient (DDPG).

I would like to know if it is possible to apply this algorithm to an optimization problem where I have both time-independent and time-dependent manipulated variables. This would mean that the Actor-network would output two different actions (2-dimensional vector). Considering that an episode is made of X number of timesteps, one action would obtain the same value throughout the entire episode and the second action would be changing at every timestep. The idea is to call the exploration and exploitation at different frequencies for each action.

When I run my code in this way, I get reasonable results, however, I am not sure if this is correct.

  • $\begingroup$ It might be a good idea to describe more in detail your specific problem and what you mean by "reasonable results". It seems that you're producing an action for every step of an episode and action for one episode. Is this correct? $\endgroup$
    – nbro
    Apr 14 at 12:18


You must log in to answer this question.

Browse other questions tagged .