Skip to main content

All Questions

Filter by
Sorted by
Tagged with
2 votes
0 answers
90 views

Does coarse coding with radial basis function generate fewer features?

I am learning about discretization of the state space when applying reinforcement learning to continuous state space. In this video the instructor, at 2:02, the instructor says that one benefit of ...
farhanhubble's user avatar
1 vote
1 answer
511 views

How can $\nabla \hat{v}\left(S_{t}, \mathbf{w}_{t}\right)$ be 1 for $S_{t}$ 's group's component and 0 for the other components?

In Sutton's RL:An introduction 2nd edition it says the following(page 203): State aggregation is a simple form of generalizing function approximation in which states are grouped together, with one ...
Miguel Saraiva's user avatar
1 vote
0 answers
34 views

What is the difference between the $Q_a$ calculated to update delta and those to select next action in the exploitation phase?

As the title suggests, I have a doubt about the computation of the $Q_a$ used to update the delta and the $Q_a$ used to select the next action in the exploitation phase, as shown below (source of ...
Francesco Vignola's user avatar