I have encountered the gym environment and decided to create AI that plays breakout. Here is the link: https://gym.openai.com/envs/Breakout-ram-v0/.

The documentation says that the state is represented as a RAM state, but what is the RAM in this context? Is it the random access memory? What does the RAM state represent?


Yes, it is the state of the memory; this would mainly involve variables, since the code would be in ROM. Since it is only 128 bytes in size, the screen memory would also not be included in this.

The idea is that all information relevant to the game is captured in these 128 bytes; they represent the state of the game world at any given time. Movements of the ball, the game controller position, etc are all encoded there.

For machine learning it is not actually relevant which bytes are representing which value, as any optimisation of outcomes will treat all these 128 bytes as parameters describing the state. A machine learning system will pick up the optimal configuration through the learning process, eg that the 'racket' position should always near the ball x-coordinate. That will just be a correlation of two bytes, no matter which ones they actually are.

| improve this answer | |
  • $\begingroup$ and what does this information represents?what state of memory i don't understand this term at all, please help me $\endgroup$ – dato nefaridze Jun 1 at 10:30
  • $\begingroup$ if you were given array of 128 numbers and told to build neural network, isn't it important what these 128 numbers represents?it's very abstract to me. $\endgroup$ – dato nefaridze Jun 1 at 10:31
  • $\begingroup$ @datonefaridze see update $\endgroup$ – Oliver Mason Jun 1 at 10:35

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.