My goal is to understand AlphaZero paper published by deepmind. I'm beginning my journey trying to get the basic intuition of reinforcement learning from the book by Barto and Sutton.

As per my background, I'm familiar with MDPs, value iteration and policy iteration.

I wanted to ask till what chapter of Barto and Sutton's book is one required to read in order to fully comprehend AlphaZero paper. Monte-Carlo Tree Search is discussed in Chapter-8 of the book. Will it be enough till that? Or would I be needing more resources apart from this book? Thanks.

  • $\begingroup$ Start reading the paper and look up the things that you don't understand or ask a question about it. $\endgroup$ – Brale Jun 18 '19 at 21:12
  • $\begingroup$ After completing the relevant chapter of the book, I would suggest you take a look at the cited references in the paper (especially those parts that you feel you need more materials). $\endgroup$ – Borhan Kazimipour Jun 20 '19 at 1:24

The more you read, the more deeply you can understand any paper, but given your stated background, reading the Monte-Carlo Tree Search chapter of Barto & Sutton, plus Gerald Tesauro's TD-Gammon paper (which is pretty accessible, and which is the basis for the other technique used in AlphaZero) should be enough to get a pretty good idea of what they did.


Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.