Questions tagged [tile-coding]
For questions related to tile coding, a form of coarse coding that is particularly well suited for use on sequential digital computers and for efficient online learning.
6
questions
4
votes
1
answer
72
views
How does uniform offset tiling work with function approximation?
I get the fundamental idea of how tilings work, but, in Barton and Sutton's book, Reinforcement Learning: An Introduction (2nd edition), a diagram, on page 219 (figure 9.11), showing the variations of ...
- 374
4
votes
0
answers
245
views
When using hashing in tile coding, why are memory requirements reduced and there is only a little loss of performance?
In the book "Reinforcement Learning: An Introduction" (2018) Sutton and Barto explain, on page 221, a form of tile coding using hashing, to reduce memory consumption.
I have two questions ...
- 291
2
votes
0
answers
56
views
Does coarse coding with radial basis function generate fewer features?
I am learning about discretization of the state space when applying reinforcement learning to continuous state space. In this video the instructor, at 2:02, the instructor says that one benefit of ...
- 181
1
vote
0
answers
145
views
Can someone explain to me this implementation of Tile Coding using Hash Tables?
The code below is adapted from this implementation.
...
- 111
0
votes
1
answer
31
views
Unclear paragraph in Sutton-Barto on "Tile Coding"
Sutton-Barto (Tile Coding, page 218):
For example, choosing $\alpha = 1/n$, where n is the number
of tilings, results in exact one-trial learning. If the example $s\to v$ is trained on, then
whatever ...
- 194
0
votes
0
answers
8
views
How are the 8 subfigures created in tile coding for offseting uniformly in each dimension the 8 tilings from each other?
The following is a figure from Sutton-Barto (Section Tile Coding, page 219)
to show how the choice of offseting uniformly in each dimension the tilings from each other affects generalization.
It is ...
- 149