I haven't been able to understand the output that OpenAI gym return for observation from this snippet
env = gym.make('ALE/Breakout-ram-v5', render_mode='human', obs_type='grayscale')
obv = env.reset()
print(obv)
from the OpenAI documentation it suggest it return the pixel data from camera, I am guessing that it a the game state representation at a given step. (I might be wrong here, I am still new to OpenAI)
Assuming if it is the pixel data from camera, How can I retrieve information like where the paddle position, the ball velocity (incl. direction) such that it satisfy Markov Properties for Q-Learning