All Questions
Tagged with features function-approximation
3 questions
1
vote
0
answers
34
views
What is the difference between the $Q_a$ calculated to update delta and those to select next action in the exploitation phase?
As the title suggests, I have a doubt about the computation of the $Q_a$ used to update the delta and the $Q_a$ used to select the next action in the exploitation phase, as shown below (source of ...
2
votes
0
answers
90
views
Does coarse coding with radial basis function generate fewer features?
I am learning about discretization of the state space when applying reinforcement learning to continuous state space. In this video the instructor, at 2:02, the instructor says that one benefit of ...
- 181
1
vote
1
answer
511
views
How can $\nabla \hat{v}\left(S_{t}, \mathbf{w}_{t}\right)$ be 1 for $S_{t}$ 's group's component and 0 for the other components?
In Sutton's RL:An introduction 2nd edition it says the following(page 203):
State aggregation is a simple form of generalizing function approximation in which states are grouped together, with one ...
- 797