This is the equation where n denotes the current state, (n-1) denotes the state in the previous step etc.

And to do back-propagation I need to find partial derivatives over each of the variables. For now let's just focus on

The term in the above equation can be written as:

Since it also contains , it needs to be substituted into the first equation. But this is where the issue starts. I also need to then substitute in the equation above with this:

Which contains , and so does . And I end up in a never ending loop.

So how to do this?


Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.