New answers tagged

2 votes
Accepted

How do I create an AI controller for Pacman?

About the environments For the controller part of your question, I would advice looking at openAI gym. https://www.gymlibrary.ml/content/environment_creation/ #how to make your own gym enviroment ...
user avatar
  • 349
1 vote
Accepted

How to compare memory requirements for tabular Q-learning vs deep neural network?

You don't say, but I suspect from your description, that you have designed the neural network to operate over one-hot-encoding representations of states and actions. Using such a representation offers ...
user avatar
  • 23.9k
1 vote

Is the described Q-table considered large?

There a couple of "rules of thumb" you might apply to decide whether a Q table is large enough that some kind of approximation would help: Does it fit into memory? Does the rate of ...
user avatar
  • 23.9k
0 votes
Accepted

Is it possible to add states to the Q-table after the game has started?

Yes, it is possible to add states to a Q table after the game has started, for example by storing the "table" in a binary tree. Nonetheless, with a simple interpretation of state (like all ...
user avatar
1 vote
Accepted

How to deal with changing rewards in Q-learning? DQN?

Is my definition of 'state' or 'action' wrong? I hesitate to say 'wrong', but that's not how state and action are defined in RL, and that mismatch might make the algorithms hard to understand. In RL ...
user avatar

Top 50 recent answers are included