Questions tagged [discrete-state-spaces]

For questions about discrete state spaces, in the context of reinforcement learning or other AI sub-fields.

Filter by
Sorted by
Tagged with
2
votes
0answers
27 views

How to find good features for a linear function approximation in RL with large discrete state set?

I've recently read much about feature engineering in continuous (uncountable) feature spaces. Now I am interested what methods exist in the setting of large discrete state spaces. For example consider ...
3
votes
1answer
97 views

Does DQN generalise to unseen states in the case of discrete state-spaces?

In my understanding, DQN is useful because it utilises a neural network as a q-value function approximator, which, after the training, can generalise to unseen states. I understand how that would work ...
0
votes
0answers
9 views

Given a system state, generate a sequence of state changes that lead to it

These systems are discrete and their state changes are rule based. Example: Given a chess position, generate a series of moves that will lead to it (there may be many, one, or none, but I only need ...
18
votes
2answers
11k views

How to define states in reinforcement learning?

I am studying reinforcement learning and the variants of it. I am starting to get an understanding of how the algorithms work and how they apply to an MDP. What I don't understand is the process of ...