We’re rewarding the question askers & reputations are being recalculated! Read more.

Questions tagged [deepmind]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
2
votes
0answers
31 views

AlphaGo Zero: Does the policy head give a probability for every possible move?

If I understood correctly, the AlphaGo Zero network returns two values: a vector of logit probabilities p and a value v. My question is: in this vector that it is outputted, do we have a probability ...
1
vote
1answer
18 views

Deepmind Spriteworld run_demo.py not found

I'm trying to run the Deepmind Spriteworld demo described on the project's GitHub page, but I'm not finding run_demo.py in the distribution and the closest sounding ...
0
votes
0answers
21 views

A2C for the game of Hanabi underfits

I am trying to solve the game of Hanabi (paper describing game) with actor-critic algorithm. I took code for the environment from the Deepmind's repository and implemented a2c algorithm myself. From ...
1
vote
1answer
34 views

Alpha Zero queen promotion

"The final 9 planes encode possible underpromotions for pawn moves or captures in two possible diagonals, to knight, bishop or rook respectively. Other pawn moves or captures from the ...
0
votes
0answers
31 views

Questions performance SimPLe pong for AI demo

For a demo I need to develop an AI solution to learn how to play pong. I have the following requirements: Computer needs to play against a human player. Learn while playing the game. Poor AI result ...
2
votes
1answer
208 views

How does DeepMind perform reinforcement learning on a TPU?

I've watched this video of the recent contest of AlphaStar Vs Pro players of StarCraft2, and during the discussion David Silver of DeepMind said that they train AlphaStar on TPUs. My question is, how ...
3
votes
2answers
322 views

Each training run for DDQN agent takes 2 days, and still ends up with -13 avg score, but OpenAi baseline DQN needs only an hour to converge to +18?

Status: For a few weeks now, I have been working on a Double DQN agent for the PongDeterministic-v4 environment, which you can find here. A single training run ...
2
votes
2answers
121 views

3D environment for RL research in Academia

I'm doing my thesis on Reinforcement Learning. My focus on Partially Observable Environments like 3D Games. I want to choose a 3D platform for testing and doing ...
1
vote
0answers
85 views

How will AlphaGo be implemented in Tensorflow.js?

AlphaGo is eventually going to be implemented in Tensorflow.js. How to tackle the change of functionality that the new JavaScript language will bring?
3
votes
2answers
303 views

VAE image reconstruction question?

Is it possible to use a VAE to reconstruct and image starting from an initial image instead of using K.random_normal as show in the “sampling” function of this example? I have used a sample image ...
3
votes
1answer
669 views

What is regression layer in a spatial transformer?

I came across this line while reading the original paper on Spatial Transformers by Deepmind in the last paragraph of Sec 3.1: The localisation network function floc() can take any form, such as a ...
2
votes
1answer
194 views

Is it common in RL research with Atari/ALE to automatically press FIRE to start games?

In some Atari games in the Arcade Learning Environment (ALE), it is necessary to press FIRE once to start a game. Because it may be difficult for a Reinforcement ...
7
votes
2answers
2k views

What's the difference between Starcraft and Dota from an AI perspective?

So, Deepmind is pushing for a human level Starcraft bot and Open AI just created a human level 1vs1 Dota bot. Unfortunately, I've no clue what that signifies because I've never played Starcraft nor ...
9
votes
2answers
463 views

Was DeepMind's DQN Atari game learning simultaneous?

DeepMind state that their deep Q-network (DQN) was able to continually adapt its behavior while learning to play 49 Atari games. After learning all games with the same neural net, was the agent ...
4
votes
1answer
907 views

Why did AlphaGo lose its Go game?

We can read on wiki page that in March 2016 AlphaGo AI lost its game (1 of 5) to Lee Sedol, a professional Go player. One article cite says: AlphaGo lost a game and we as researchers want to ...