0
$\begingroup$

I'm trying to implement soft actor-critic algorithm for financial data (stock prices) and I have trouble with losses, no matter what combination of HyperParameters I enter, they are not converging, and basically it caused bad reward return as well. It sounds like the agent is not learning at all.

I already tried to tune some hyperparameters ( Learning rate for each network + number of hidden layers) but I always get similar results. the two Plots below represent the losses of my policy and one of the value functions during last episode of training.

enter image description here

enter image description here

My question is, would it be related to the data itself (nature of data) or is it something related to the logic of the code?

$\endgroup$
0
$\begingroup$

I would say it is the nature of data. Generally speaking, you are trying to predict a random sequence, especially if you use the history data as an input and try to get the future value as an output.

| improve this answer | |
$\endgroup$
  • $\begingroup$ Yes , I am trying another approach now by extracting more data from the temporal series ( historical prices ) by augmenting the data itself, it shows better results but still unstable. $\endgroup$ – Zahra 2 days ago

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.