1
$\begingroup$

During my research for Google DeepMind's Go-playing program Alpha Go and its successor Alpha Go Zero, I discovered that the system uses a clever pipeline and an interplay of blocks of both policy and value networks to play the game of Go in such a way, that it is able to outperform even the best players in the world. This is in particular remarkable, because the game of Go was considered to be unsolvable a few years ago. This success gained international attention and it was labeled as a breakthrough in the community of AI. It is also not a secret that the research team behind AlphaGo and AlphaGo Zero used lots of computation power to create such a sophisticated system.

But, since each board configuration is considered as a distinct state, where algorithms can be applied really well, and just consider AlphaGo Zero, which uses no prior knowledge and can figure out how the play the game of go from scratch, my question is the following:

Is there any way to state (theoretically) how the performance of AlphaGo would be in continuous action spaces (e.g. self-driving cars)?

Improve this question
$\endgroup$
3
  • 1
    $\begingroup$ The paper A0C: Alpha Zero in Continuous Action Space (although a pre-print) could be useful. $\endgroup$ – nbro♦ Dec 11 '20 at 0:18
  • $\begingroup$ I'm not familiar with reinforcement learning terminology, but are real-time video games (like tetris, breakout, pong, etc.) considered continuous action spaces? Their action space is technically discrete, but each pixel is very small compared to the total field. If yes, you might be interested in reading MuZero, which is AlphaZero's successor (AlphaZero is AlphaGo Zero's successor). MuZero generalized AlphaZero to play Atari games, which are real time video games. It achieved state of the art. arxiv.org/pdf/1911.08265.pdf $\endgroup$ – user3667125 Dec 11 '20 at 7:42
  • $\begingroup$ Thanks @nbro & @user3667125! I'll check that out. $\endgroup$ – maven Dec 11 '20 at 11:47

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.