Questions tagged [td3]

For questions related to the Twin Delayed Deep Deterministic policy gradient algorithm (TD3).

Filter by
Sorted by
Tagged with
0
votes
0answers
33 views

Is it possible to use Softmax as an activation function for actor (policy) network in TD3 or SAC Reinforcement learning algorithms?

As I understand from literature, normally, the last activation in an actor (policy) network in TD3 and SAC algorithms is a Tanh function, which is scaled by a certain limit. My action vector is ...
0
votes
0answers
22 views

RL agent policy performs worse than random policy

I am training a trading bot with TD3 and SAC algorithms. During the first 10k steps it takes uniformly random actions before running policy learnt so far. The agent starts to do gradient descent ...
0
votes
1answer
22 views

TD3 sticking to end values

I am using TD3 to train custom gym environment, but the problem is action values stick to the end. Sticking to the end values makes reward negative, to be positive it must find action values somewhere ...
0
votes
0answers
21 views

Actor-critic reinforcement learning updates and episode length

I am currently using a TD3 agent-critic network to control a vehicle suspension system, where the reward (or rather a penalty) is based on the vertical acceleration of the mass and is calculated at ...
0
votes
0answers
271 views

Optimal episode length in reinforcement learning

I have a custom environment for stock trading where an episode can be as long as 2000-3000 steps. I've run several experiments with td3 and sac algorithms, average reward per episode flattens after ...
0
votes
0answers
188 views

Which is the best RL algo for continuous states but discrete action spaces problem

I am trying to train an AI with an environment where the states are continuous but the actions are discrete, that means I can not apply DDPG or TD3. Can someone please help to let know what should be ...