Skip to main content
Search type Search syntax
Tags [tag]
Exact "words here"
Author user:1234
user:me (yours)
Score score:3 (3+)
score:0 (none)
Answers answers:3 (3+)
answers:0 (none)
isaccepted:yes
hasaccepted:no
inquestion:1234
Views views:250
Code code:"if (foo != bar)"
Sections title:apples
body:"apples oranges"
URL url:"*.example.com"
Saves in:saves
Status closed:yes
duplicate:no
migrated:no
wiki:no
Types is:question
is:answer
Exclude -[tag]
-apples
For more details on advanced search visit our help page
Results tagged with
Search options not deleted user 76030

For questions related to reinforcement learning algorithms often referred to as "policy gradients" (or "policy gradient algorithms"), which attempt to directly optimise a parameterised policy (without first attempting to estimate value functions) using gradients of an objective function with respect to the policy's parameters.

1 vote

$\gamma^t$ in REINFORCE update (Sutton-Barto RL book Exercise 13.2)

I dont understand why the $\gamma^t$ appears when you write the gradient with an expectation. Could you elaborate ? thank you I agree with you with all the things up to that point EDIT : to try to ans …
Procuste's user avatar
0 votes

$\gamma^t$ in REINFORCE update (Sutton-Barto RL book Exercise 13.2)

Went back to this question a year after, and after carefully reading your derivation, I don't understand why you can't define : $$\mu_{\gamma}(s) = \frac{\eta_\gamma(s)}{\sum_{s'} \eta_\gamma(s')}$$ H …
Procuste's user avatar