i have this idea in my mind for quite a while. I want to teach an AI to play Mario Kart on the NDS, which can hopefully beat me and my friends one day. Iam familiar with the theoretical stuff behind the learning (at least I think so) But iam wondering how to actual train the model in a practical way.
I can capture the pixel data with python and process the image. To get a better understanding of what is going on I can also use 3-4 frames as one state of the environment. This state can be given to the agents which is then taking an action and is getting the reward from the environment. Sounds simple but do I have to pause the emulation for each training step? And how do I check the outcome of the training. To I just feed the game pixels to the algorithm and hope that it will do something?