I've been reading the attached paper - which aims to model entities in the world as objects, including the learning agent itself!
To say the least, the goal is to navigate through what seems like a maze (path-planning problem) - and drop off passengers in desired destinations, while avoiding walls in the map of the world (5x5 grid for now). The objects involved are, a taxi, passengers, walls and a destination.
Now, a particular paragraph says the following:
"Whereas in the classical MDP model, the effect of encountering walls is felt as a property of specific locations in the grid, the OO-MDP view is that wall interactions are the same regardless of their location. As such, agents’ experience can transfer gracefully throughout the state space."
What does this mean? How are the classical MDP and the object-oriented MDP views different?
I can't make sense of the above extract, at all. Any help would be appreciated!
P.S. I did not consider posting parts of the extract as separate questions since my problem has more to do with understanding the extract as a whole which inevitably relies on understanding the parts.