Questions tagged [alphago-zero]

For questions related to AlphaGo Zero, which is a version of DeepMind's Go software, AlphaGo, that does not use data from human games and it is stronger than AlphaGo. There is a generalized version of AlphaGo Zero called AlphaZero, which beat the 3-day version of AlphaGo Zero by winning 60 games to 40. AlphaGo Zero was introduced in the paper "Mastering the game of Go without human knowledge" (2017) by David Silver et al.

7 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
3
votes
0answers
116 views

How is the rollout from the MCTS implemented in both of the AlphaGo Zero and the AlphaZero algorithms?

In a vanilla Monte Carlo tree search (MCTS) implementation, the rollout is usually implemented following a uniform random policy, that is, it takes random actions until the game is finished and only ...
2
votes
0answers
53 views

AlphaGo Zero: Does the policy head give a probability for every possible move?

If I understood correctly, the AlphaGo Zero network returns two values: a vector of logit probabilities p and a value v. My question is: in this vector that it is outputted, do we have a probability ...
2
votes
0answers
46 views

Alphazero Value loss doesn't decrease

Currenly I'm trying to reimplement alphazero in pure c++ using libtorch to accomodate my project's need. But when I training my model, I found out that the value loss doesn't decrese at all after even ...
1
vote
0answers
60 views

How basically AI synthesize thinking?

In the instance like AlphaGo Zero. How N' why AlphaGo Zero's training is so stable? Compared with traditional game theory applied in Deep RN technique!? How "AlphaGo Zero" differs from "...
0
votes
0answers
26 views

Structure for neural network

My purpose is to apply deep learning for planning. To do so, I decided to use a similar approach as AlphaGo. But my "game state" is very different. Instead of considering some planes ...
0
votes
0answers
55 views

Total loss increasing, but loss components are decreasing?

I am writing a AlphaGo Zero clone, and sometimes in the training the policy head loss and value head loss would both be decreasing, but the total loss is increasing? How is this possible? I am using ...
0
votes
0answers
31 views

How does (or should) AlphaGoZero (which does chess) fare against Deep Blue?

Deep blue is good at chess, but is more "hand-coded" or "top-down". https://en.wikipedia.org/wiki/Deep_Blue_(chess_computer) AlphaGoZero is "self-taught", and at Go is very much super-human. https://...