Questions tagged [tile-coding]

For questions related to tile coding, a form of coarse coding that is particularly well suited for use on sequential digital computers and for efficient online learning.

Filter by
Sorted by
Tagged with
0 votes
0 answers
7 views

How are the 8 subfigures created in tile coding for offseting uniformly in each dimension the 8 tilings from each other?

The following is a figure from Sutton-Barto (Section Tile Coding, page 219) to show how the choice of offseting uniformly in each dimension the tilings from each other affects generalization. It is ...
user avatar
0 votes
1 answer
29 views

Unclear paragraph in Sutton-Barto on "Tile Coding"

Sutton-Barto (Tile Coding, page 218): For example, choosing $\alpha = 1/n$, where n is the number of tilings, results in exact one-trial learning. If the example $s\to v$ is trained on, then whatever ...
user avatar
1 vote
0 answers
126 views

Can someone explain to me this implementation of Tile Coding using Hash Tables?

The code below is adapted from this implementation. ...
user avatar
  • 111
4 votes
1 answer
70 views

How does uniform offset tiling work with function approximation?

I get the fundamental idea of how tilings work, but, in Barton and Sutton's book, Reinforcement Learning: An Introduction (2nd edition), a diagram, on page 219 (figure 9.11), showing the variations of ...
user avatar
2 votes
0 answers
56 views

Does coarse coding with radial basis function generate fewer features?

I am learning about discretization of the state space when applying reinforcement learning to continuous state space. In this video the instructor, at 2:02, the instructor says that one benefit of ...
user avatar
4 votes
0 answers
218 views

When using hashing in tile coding, why are memory requirements reduced and there is only a little loss of performance?

In the book "Reinforcement Learning: An Introduction" (2018) Sutton and Barto explain, on page 221, a form of tile coding using hashing, to reduce memory consumption. I have two questions ...
user avatar
  • 291