3 votes
Accepted

Number of states in taxi environment (Dietterich 2000)

This is more of a combinatorics than AI question but regradless, the full state information for the environment is: $(taxi \space position, passenger \space position, destination \space position)$ ...
Brale's user avatar
  • 2,376
3 votes
Accepted

How to generalise over multiple simultaneous dependent actions in Reinforcement Learning

If you want to treat the problem as a full Reinforcement Learning problem, I'd recommend to try avoiding the combinatorial explosion of the action space by treating every sub-action as a separate ...
Dennis Soemers's user avatar
  • 10.3k
2 votes

What is the state space of digit recognition agent on a grid of 28 x 28 pixels?

State space in contextual bandits or reinforcement learning covers the input space to a policy or predictive model. The question also specifies a representation for this input, which is different in ...
Neil Slater's user avatar
  • 32.1k
2 votes

Number of states in taxi environment (Dietterich 2000)

This . . . because for the agent it should be the same task to go to a certain point, regardless of whether it's on its way to pick up or to drop-off . . . might seem logical/intuitive to a person ...
Neil Slater's user avatar
  • 32.1k
2 votes

What type of reinforcement learning can I do restricted to ~200MB on an average smartphone?

I skimmed through your question and understood that the state/action space is finite, so in this case, RL would be a good option for storage. The most basic RL technique will keep track of a matrix Q ...
A.Rashad's user avatar
  • 251
1 vote

What is the difference between continuous domains and discrete combinatorial optimization?

A continous domain can be imagined as a space in which the axes of the coordinate systems are the parameters of the continous domain. If we take 2D Cartesian space as an example, it is a continous ...
50k4's user avatar
  • 225

Only top scored, non community-wiki answers of a minimum length are eligible