Questions tagged [deepmind]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
-1
votes
0answers
50 views

Is GPT-3 better than what DeepMind could do?

So there is this tremendous hype about GPT-3, which is in fact impressive. But I've been always convinced that DeepMind was by far the leader in machine learning. However, I didn't find any comparable ...
2
votes
0answers
35 views

Where does reinforcement learning actually show up in Deepmind's game engines?

From the brief research I've done on the topic, it appears that the way Deepmind's Alphazero or Muzero makes decisions is through Monte Carlo tree searches, where in the randomized simulations allows ...
1
vote
1answer
61 views

How does the AlphaGo Zero policy decide what move to execute?

I was going through the AlphaGo Zero paper and I was trying to understand everything, but I just can't figure out this one formula: $$ \pi(a \mid s_0) = \frac{N(s_0, a)^{\frac{1}{\tau}}}{\sum_b N(s_0,...
2
votes
0answers
33 views

Why Pixel RNN (Row LSTM) can capture triangular contexts?

I'm reading the paper Pixel Recurrent Neural Network. I have a question about Row LSTM. Why Row LSTM can capture triangular contexts? In this paper, the kernel of the one-dimensional convolution ...
1
vote
1answer
39 views

Which simulation platform is used by DeepMind (and others) to handle inverse kinematics musculoskeletal?

Which simulation platform is used by DeepMind and others to handle inverse kinematics musculoskeletal simulation, etc., for reinforcement learning simulations and agents? I thought they use Unity or ...
1
vote
0answers
30 views

Is AlphaStar still competing in the Star Craft ladder?

Last year it was announced that Deepmind's Starcraft playing bot AlphaStar was taking on human players in the Starcraft ladder system (some kind of league system as far as I can tell) and that it had ...
1
vote
0answers
126 views

What's the difference in using multiple convolutional layers and no pooling versus using a single convolutional layer and a single max pooling layer?

I'm currently working on a college project in which I'm designing a Deep Q-Network that takes images/frames as an input. I've been searching online to see how other people have designed their ...
2
votes
0answers
48 views

AlphaGo Zero: Does the policy head give a probability for every possible move?

If I understood correctly, the AlphaGo Zero network returns two values: a vector of logit probabilities p and a value v. My question is: in this vector that it is outputted, do we have a probability ...
1
vote
1answer
35 views

Deepmind Spriteworld run_demo.py not found [closed]

I'm trying to run the Deepmind Spriteworld demo described on the project's GitHub page, but I'm not finding run_demo.py in the distribution and the closest sounding ...
0
votes
0answers
50 views

A2C for the game of Hanabi underfits

I am trying to solve the game of Hanabi (paper describing game) with actor-critic algorithm. I took code for the environment from the Deepmind's repository and implemented a2c algorithm myself. From ...
1
vote
1answer
46 views

Alpha Zero queen promotion

"The final 9 planes encode possible underpromotions for pawn moves or captures in two possible diagonals, to knight, bishop or rook respectively. Other pawn moves or captures from the ...
1
vote
0answers
38 views

Questions performance SimPLe pong for AI demo

For a demo I need to develop an AI solution to learn how to play pong. I have the following requirements: Computer needs to play against a human player. Learn while playing the game. Poor AI result ...
4
votes
1answer
417 views

How does DeepMind perform reinforcement learning on a TPU?

I've watched this video of the recent contest of AlphaStar Vs Pro players of StarCraft2, and during the discussion David Silver of DeepMind said that they train AlphaStar on TPUs. My question is, how ...
3
votes
2answers
869 views

Each training run for DDQN agent takes 2 days, and still ends up with -13 avg score, but OpenAi baseline DQN needs only an hour to converge to +18?

Status: For a few weeks now, I have been working on a Double DQN agent for the PongDeterministic-v4 environment, which you can find here. A single training run ...
2
votes
2answers
164 views

3D environment for RL research in Academia

I'm doing my thesis on Reinforcement Learning. My focus on Partially Observable Environments like 3D Games. I want to choose a 3D platform for testing and doing ...
1
vote
0answers
99 views

How will AlphaGo be implemented in Tensorflow.js?

AlphaGo is eventually going to be implemented in Tensorflow.js. How to tackle the change of functionality that the new JavaScript language will bring?
3
votes
2answers
398 views

VAE image reconstruction question?

Is it possible to use a VAE to reconstruct and image starting from an initial image instead of using K.random_normal as show in the “sampling” function of this example? I have used a sample image ...
3
votes
1answer
766 views

What is regression layer in a spatial transformer?

I came across this line while reading the original paper on Spatial Transformers by Deepmind in the last paragraph of Sec 3.1: The localisation network function floc() can take any form, such as a ...
3
votes
1answer
236 views

Is it common in RL research with Atari/ALE to automatically press FIRE to start games?

In some Atari games in the Arcade Learning Environment (ALE), it is necessary to press FIRE once to start a game. Because it may be difficult for a Reinforcement ...
7
votes
2answers
2k views

What's the difference between Starcraft and Dota from an AI perspective?

So, Deepmind is pushing for a human level Starcraft bot and Open AI just created a human level 1vs1 Dota bot. Unfortunately, I've no clue what that signifies because I've never played Starcraft nor ...
9
votes
2answers
498 views

Was DeepMind's DQN Atari game learning simultaneous?

DeepMind state that their deep Q-network (DQN) was able to continually adapt its behavior while learning to play 49 Atari games. After learning all games with the same neural net, was the agent ...
5
votes
1answer
1k views

Why did AlphaGo lose its Go game?

We can read on wiki page that in March 2016 AlphaGo AI lost its game (1 of 5) to Lee Sedol, a professional Go player. One article cite says: AlphaGo lost a game and we as researchers want to ...