1
$\begingroup$

I think reinforcement learning would be a good fit for this problem, but I am not sure of how to deal with a seemingly infinite number of actions. In the beginning of each game (generic RTS game), the player places down units anywhere on the map. Then as the game progresses, the player can move units around by selecting on them and clicking on a valid location on the map. They must take into consideration things like distance and travel time. An AI agent must do the same.

How would I represent these actions? It’s not as simple as selecting ‘up’, ‘down’, ‘right’,...etc. Should the agent just randomly pick locations on the map?

Are there any papers or implementations I can look at to help me get started?

Improve this question
$\endgroup$
4
  • $\begingroup$ Randomly selecting positions on the map will be problematic with RTS because of the combinatorial explosion--although the space is not formally continuous, it is effectively continuous in terms of game tree tractability. (Have you thought about trying to abstract a little by reducing the map to a still-intractable-but-more-manageable number of cells or regions? $\endgroup$ – DukeZhou♦ May 21 '19 at 18:56
  • $\begingroup$ (how much computing power do you have?) $\endgroup$ – Guillermo Mosse May 21 '19 at 19:29
  • $\begingroup$ You should probably check out deepmind.com/blog/… $\endgroup$ – Jaden Travnik♦ May 21 '19 at 19:57
  • $\begingroup$ you could have an entire 2d map represented as a coordinate system and then actions would be coordinates of where you want to send the units on the map. This is just an idea, didn't try it and don't know if it would work. $\endgroup$ – Brale May 21 '19 at 20:42

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.