Questions tagged [atari-games]

For questions related to the Atari games, which are often used in reinforcement learning (RL) as standard problems to test new RL algorithms or methods.

Filter by
Sorted by
Tagged with
1
vote
0answers
32 views

Too slow search using MCTS in OpenAI Atari games

I'm recently using Monte Carlo Tree Search in OpenAi Gym Atari, but the result isn't satisfying. Without render, the game lasts about 180 steps ( env.step() was called this much time ) with random ...
1
vote
1answer
40 views

Why does the Atari Gym Amidar environment only move after a certain number of episodes? [closed]

When I try to run Amidar even without RL code, I cannot get the environment to move immediately. It takes about 100 steps before the game actually starts moving. I use the following simple code to ...
0
votes
0answers
17 views

Neuroevolution + RL: How to make sure my policies are more diverse?

I currently implemented Deep Neuroevolution and used it on a couple of Atari games. For my implementation I used a similar Genetic Algorithm, network and setup as the Uber AI Deep Neuroevolution paper ...
0
votes
0answers
26 views

Is there a resource that explains which settings mean 'High' or 'Low' difficulty in the ALE environment?

I have been using AIgym to train my RL agents. I am now trying to take advantage of the different difficulty settings that the ALE offers. However I can't find a resource that explains which ...
1
vote
1answer
39 views

Deep Reinforcement Learning Atari: how does the agent understand motion?

Basic deep reinforcement learning methods use as input an image for the current state, do some convolutions on that image, apply some reinforcement learning algorithm and it is solved. Let us take the ...
0
votes
0answers
32 views

How to train a hierarchical DQN to play the Montezuma's Revenge game?

Would anybody share the experience on how to train a hierarchical DQN to play the Montezuma's Revenge game? How should I design the reward function? How should I balance the anneal rate of the two-...
1
vote
0answers
101 views

Why isn't my DQN agent improving when trained on Atari Breakout?

Lately, I have implemented DQN for Atari Breakout. Here is the code: https://github.com/JeremieGauthier/AI_Exercices/blob/master/Atari_Breakout/DQN_Breakout.py I have trained the agent for over ...
2
votes
0answers
34 views

How was the DQN trained to play many games?

Some people claim that DQN was used to play many Atari games. But what actually happened? Was DQN trained only once (with some data from all games) or was it trained separately for each game? What was ...
1
vote
0answers
79 views

Getting score values from openai gym rom

I am using the SpaceInvaders-ram-v0 from OpenAI gym. I want to extract the game's current score using the RAM values. How do I get it? I tried doing some research ...
1
vote
0answers
41 views

Questions performance SimPLe pong for AI demo

For a demo I need to develop an AI solution to learn how to play pong. I have the following requirements: Computer needs to play against a human player. Learn while playing the game. Poor AI result ...
1
vote
1answer
48 views

IQN bellman target: using Z vs using Q

IQN paper (https://arxiv.org/abs/1806.06923) uses distributional bellman target: $$ \delta^{\tau,\tau'}_t = r_t + \gamma Z_{\tau'}(x_{t+1}, \pi_{\beta}(x_{t+1})) - Z_{\tau}(x_t, a_t) $$ And optimizes: ...
2
votes
0answers
76 views

When can we say an RL algorithm learns an Atari game?

If an Atari game's rewards can be between $-100$ and $100$, when can we say an agent learned to play this game? Should it get the reward very close to $100$ for each instance of the game? Or it is ...