Questions tagged [alphago-zero]

For questions related to AlphaGo Zero, which is a version of DeepMind's Go software, AlphaGo, that does not use data from human games and it is stronger than AlphaGo. There is a generalized version of AlphaGo Zero called AlphaZero, which beat the 3-day version of AlphaGo Zero by winning 60 games to 40. AlphaGo Zero was introduced in the paper "Mastering the game of Go without human knowledge" (2017) by David Silver et al.

6 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
4
votes
0answers
305 views

How is the rollout from the MCTS implemented in both of the AlphaGo Zero and the AlphaZero algorithms?

In a vanilla Monte Carlo tree search (MCTS) implementation, the rollout is usually implemented following a uniform random policy, that is, it takes random actions until the game is finished and only ...
2
votes
0answers
85 views

AlphaGo Zero: Does the policy head give a probability for every possible move?

If I understood correctly, the AlphaGo Zero network returns two values: a vector of logit probabilities p and a value v. My question is: in this vector that it is outputted, do we have a probability ...
2
votes
0answers
61 views

Alphazero Value loss doesn't decrease

Currenly I'm trying to reimplement alphazero in pure c++ using libtorch to accomodate my project's need. But when I training my model, I found out that the value loss doesn't decrese at all after even ...
1
vote
0answers
34 views

Is there a way to beat AlphaGo Zero with different method?

As I read the research from https://deepmind.com/research It seem AlphagoZero use zero knowledge and use Reinforcement learning to improve the ai skill of playing. Is there a way to beat AlphagoZero? ...
1
vote
0answers
63 views

How does policy network learn in AlphaZero?

I'm currently trying to understand how AlphaZero works. There is one thing with the training of the AlphaZero's policy head that confuses me. Basically, in AlphaGo Zero's paper (where the major part ...
0
votes
0answers
34 views

How does (or should) AlphaGoZero (which does chess) fare against Deep Blue?

Deep blue is good at chess, but is more "hand-coded" or "top-down". https://en.wikipedia.org/wiki/Deep_Blue_(chess_computer) AlphaGoZero is "self-taught", and at Go is very much super-human. https://...