Newest 'open-ai' Questions

1

vote

1answer

34 views

Delayed state observation or caching action in OpenAI gym. Can it still learn?

I am planning to use OpenAI gym for my experiment in real life. In my experiment design, by the limits of a real-life scenario, I can only receive the state information or the rewards about 2-3 ...

asked Sep 1 at 20:35

Ykwk

132 bronze badges

2

votes

1answer

28 views

Why adding a baseline doesn't affect the policy gradient?

On the OpenAI's Spinning Up, they justify the fact that adding a baseline $b(s_t)$ in the policy gradient doesn't change its gradient by saying that this is an immediate consequence of the EGLP Lemma ...

policy-gradients proofs open-ai reinforce

asked Jul 7 at 15:13

Thomas Hustache

211 bronze badge

1

vote

2answers

130 views

Will AI replace software developers?

I'm 26, working for five years as a software developer and really worried because of new technologies like Github Copilot and GPT-3 in general. Do you think AI will replace software developers? If so, ...

open-ai software-development gpt-3

asked Jun 30 at 16:23

20millionmiles

111 bronze badge

1

vote

0answers

41 views

Too slow search using MCTS in OpenAI Atari games

I'm recently using Monte Carlo Tree Search in OpenAi Gym Atari, but the result isn't satisfying. Without render, the game lasts about 180 steps ( env.step() was called this much time ) with random ...

reinforcement-learning monte-carlo-tree-search open-ai gym atari-games

asked Jun 21 at 7:46

TurboDibbla

111 bronze badge

0

votes

0answers

33 views

Bridging the gap between simulation and real-world scenarios!

I've got a DRL model that was trained on a simulation at a frame rate of 100fps, after testing it with 100fps it gives good results however when testing it with another frame rate say 50fps it gives a ...

reinforcement-learning deep-rl deep-neural-networks open-ai gym

asked Jun 10 at 9:49

BAKYAC

364 bronze badges

1

vote

1answer

42 views

Why does the Atari Gym Amidar environment only move after a certain number of episodes? [closed]

When I try to run Amidar even without RL code, I cannot get the environment to move immediately. It takes about 100 steps before the game actually starts moving. I use the following simple code to ...

reinforcement-learning open-ai gym atari-games

asked May 18 at 14:13

Lennart

132 bronze badges

0

votes

0answers

51 views

Open AI Taxi - Agent fails to learn an effective policy

I'm trying to solve the openai gym taxi problem (v3) using deep q learning. I've already had some success with the q-table approach, but for the life of me cannot manage to train a NN to learn a ...

reinforcement-learning open-ai gym

asked Apr 14 at 15:03

Sledge

1033 bronze badges

0

votes

1answer

33 views

Is is not possible to achieve average reward of more than 20-40 with simple Q-Learning

I have implemented the simple Q-Learning based solution for AI-gym's Cartpole-v0. However, despite changing hyper-parameters, and rechecking my code, I cannot get an average reward (N-running reward) ...

q-learning rewards open-ai gym

asked Apr 11 at 10:37

Kashan

3211 silver badge10 bronze badges

1

vote

0answers

25 views

What is the meaning of "Our current objective weights every token equally and lacks a notion of what is most important to predict" in the GPT-3 paper?

On page 34 of OpenAI's GPT-3, there is a sentence demonstrating the limitation of objective function: Our current objective weights every token equally and lacks a notion of what is most important to ...

natural-language-processing papers open-ai gpt-3

asked Apr 11 at 0:39

exteral

1111 bronze badge

0

votes

0answers

34 views

Deployment of a DeepRL model trained on a custom OpenAI-GYM environment

I developed a custom OpenAI-GYM environment and trained a CDQN model on it, now I am trying to figure out how can I test it not using my gym environment but in production (using real world ...

reinforcement-learning python deep-rl open-ai gym

asked Mar 29 at 8:13

BAKYAC

364 bronze badges

1

vote

0answers

54 views

How should I simulate this Markov Decision Process?

I am working on solving a problem on nodes in a graph communicating with each other. They try to estimate a central state using Kalman consensus filter, with the connections described by the graph's ...

reinforcement-learning python deep-rl open-ai

asked Feb 19 at 17:27

Suraj Joshi

111 bronze badge

0

votes

2answers

292 views

Simple DQN too slow to train [closed]

I have been trying to solve the OpenAI lunar lander game with a DQN taken from this paper https://arxiv.org/pdf/2006.04938v2.pdf The issue is that it takes 12 hours to train 50 episodes so something ...

reinforcement-learning deep-learning tensorflow q-learning open-ai

asked Jan 3 at 15:08

Marc

1012 bronze badges

1

vote

0answers

102 views

How to deal with KerasRL DDPG algorithm getting stuck in a local optima?

I am using KerasRL DDPG to try to learn a policy on my own custom environment, but the agent is stuck in a local optima although I am adding the OrnsteinUhlenbeck randomization process. I used the ...

reinforcement-learning keras open-ai gym ddpg

asked Dec 17 '20 at 13:02

BAKYAC

364 bronze badges

0

votes

0answers

26 views

Is there a resource that explains which settings mean 'High' or 'Low' difficulty in the ALE environment?

I have been using AIgym to train my RL agents. I am now trying to take advantage of the different difficulty settings that the ALE offers. However I can't find a resource that explains which ...

reinforcement-learning open-ai gym atari-games

asked Nov 17 '20 at 13:16

Billy.G

1

vote

1answer

225 views

How do I create a custom gym environment based on an image?

I am trying to create my own gym environment for the A3C algorithm (one implementation is here). The custom environment is a simple login form for any site. I want to create an environment from an ...

reinforcement-learning open-ai gym a3c

asked Nov 3 '20 at 15:54

Ren

213 bronze badges

1

vote

0answers

31 views

What is the difference between step_model and train_model in the OpenAI implementation of the A2C algorithm?

I'm struggling a little with understanding the OpenAI implementation of A2C in the baselines (version 2.9.0) package. From my understanding, one ...

reinforcement-learning open-ai implementation advantage-actor-critic

asked Oct 24 '20 at 9:47

sjokkopudd

111 bronze badge

5

votes

2answers

288 views

My Deep Q-Learning Network does not learn for OpenAI gym's cartpole problem

I am implementing OpenAI gym's cartpole problem using Deep Q-Learning (DQN). I followed tutorials (video and otherwise) and learned all about it. I implemented a code for myself and I thought it ...

reinforcement-learning dqn deep-neural-networks open-ai gym

asked Aug 11 '20 at 15:42

Kashan

3211 silver badge10 bronze badges

2

votes

0answers

70 views

Most of state-action pairs remain unvisited in the q-table

In building my first Q-learning algorithm for OpenAI gym's CartPole problem, many of my states remain unvisited. I believe it is the reason that my agent does not learn. Can I be told of the reasons I ...

reinforcement-learning q-learning open-ai gym

asked Jul 28 '20 at 6:49

Kashan

3211 silver badge10 bronze badges

1

vote

0answers

85 views

OpenAI gym's CartPole problem system does not learn

My OpenAI CartPole-v0 problem's implementation using basic Q-learning does not learn at all. I am a beginner and have implemented my first ever Q-learning from scratch after learning from tutorials. ...

q-learning open-ai gym

asked Jul 27 '20 at 22:11

Kashan

3211 silver badge10 bronze badges

5

votes

1answer

2k views

What exactly are the "parameters" in GPT-3's 175 billion parameters and how are they chosen/generated?

When I studied neural networks, parameters were learning rate, batch size etc. But even GPT3's ArXiv paper does not mention anything about what exactly the parameters are, but gives a small hint that ...

recurrent-neural-networks open-ai transformer attention gpt

asked Jul 26 '20 at 8:12

Nav

2711 silver badge8 bronze badges

4

votes

1answer

229 views

Why is GPT-3 such a game changer?

I've been hearing a lot about GPT-3 by OpenAI, and that it's a simple to use API with text in text out and has a big neural network off 175B parameters. But how did they achieve this huge number of ...

reinforcement-learning open-ai gpt

asked Jul 19 '20 at 19:23

parzival

412 bronze badges

0

votes

1answer

318 views

How can I change observation states' values in OpenAI gym's cartpole environment?

I am learning with the OpenAI gym's cart pole environment. I want to make the observation states discrete (with small stepsize) and for that purpose, I need to change two of the observations from [$ -\...

reinforcement-learning q-learning open-ai gym

asked Jul 18 '20 at 19:32

Kashan

3211 silver badge10 bronze badges

1

vote

0answers

40 views

How can I convert a simple CLI RPG to a compatible environment for training an RL agent via stable-baselines?

What would be the good choice of algorithm to use for character action selection in an RPG, implemented in Python? I had previously asked this question in the hopes of getting headway on the AI ...

reinforcement-learning game-ai getting-started open-ai

asked Jul 15 '20 at 19:34

SeunOsiko

213 bronze badges

1

vote

1answer

265 views

How do I test an LSTM-based reinforcement learning model using any Atari games in OpenAI gym?

I am writing a couple of different reinforcement learning models based on Rainbow DQN or some PG models. All of them internally use an LSTM network because my project is using time series data. I ...

machine-learning reinforcement-learning long-short-term-memory open-ai time-series

asked Jun 21 '20 at 14:41

ZXY

311 bronze badge

1

vote

1answer

72 views

Is there a general file type associated with AI projects?

This is a general question. Is there a general file type associated with AI projects? Photoshop = .psd Excel = csv Artificial Intelligence = ?

open-ai implementation

asked May 26 '20 at 5:12

user8273608

111 bronze badge

0

votes

1answer

39 views

How to add more than 1 agent in one generation with Q Learning

Sometimes the agent learns a bit slow and you want to have multiple agents in one generation. And at each episode you'll draw on the screen only the best of them or all of them. How is that possible? ...

reinforcement-learning ai-design q-learning open-ai

asked May 20 '20 at 15:55

Marc Vana

153 bronze badges

2

votes

1answer

98 views

What should the action space for the card game Crib be?

I'm working on creating an environment for a card game, which the agent chooses to discard certain cards in the first phase of the game, and uses the remaining cards to play with. (The game is Crib if ...

reinforcement-learning ai-design open-ai environment gym

asked May 19 '20 at 20:29

Jordan Coil

233 bronze badges

1

vote

1answer

120 views

Can we combine Off-Policy with On-Policy Algorithms?

On-Policy Algorithms like PPO directly maximize the performance objective or an approximation of it. They tend to be quite stable and reliable but are often sample inefficient. Off-Policy Algorithms ...

reinforcement-learning deep-rl open-ai off-policy-methods on-policy-methods

asked May 7 '20 at 20:03

Ray Walker

3912 silver badges7 bronze badges

1

vote

0answers

40 views

State-of-the-art algorithms not working on a custom RL environment

I'm trying to train a RL agent on a custom, highly stochastic environment (MDP). In order to do so I'm using existing implementations of state-of-the-art RL algorithms as provided by Stable Baselines. ...

reinforcement-learning deep-rl markov-decision-process rewards open-ai

asked May 5 '20 at 20:12

BGa

1295 bronze badges

1

vote

1answer

577 views

OpenAI Gym: Multiple actions in one step

I'm trying to design an OpenAI Gym environment in which multiple users/players perform actions over time. It's round based and each user needs to take an action before the round is evaluated and the ...

reinforcement-learning open-ai environment gym

asked May 5 '20 at 15:59

CGFoX

1731 silver badge7 bronze badges

1

vote

0answers

110 views

How do i start building an autoclick bot for pubg mobile?

I want to make a bot which clicks the fire button on the mobile screen upon seeing an enemies head. In pubg mobile which is an android game you have to control the fire button and the aim along with ...

python image-recognition game-ai open-ai

asked May 1 '20 at 13:14

Fardeen Khan

111 bronze badge

1

vote

0answers

137 views

How to integrate dict space of OpenAI gym into a reinforcement learning framework?

I am implementing a gym environment and I have several input arrays as my input (different sizes). The most simple method to integrate my environment into the gym is to use the dict space as my ...

reinforcement-learning open-ai gym

asked Apr 7 '20 at 20:53

Saeid Ghafouri

1434 bronze badges

2

votes

0answers

167 views

How to formulate normalization/probability conditions on state-action spaces in Gym?

I intend to develop a custom environment for open-ai's gym. My goal is for an agent to learn (among additional objectives) dividing a certain quantity drawn from a continous action space (i.e. spaces....

reinforcement-learning open-ai environment gym

asked Apr 4 '20 at 13:16

ckrk

714 bronze badges

1

vote

0answers

74 views

How to define observation and action space for an array-like input?

I am working on a problem, and I want to implement it as a reinforcement learning problem and integrate it into the OpenAI's gym. My states are in the form of lists of length $n$, where each element ...

reinforcement-learning open-ai gym

asked Apr 1 '20 at 11:31

Saeid Ghafouri

1434 bronze badges

1

vote

0answers

170 views

How can I add logic for invalid moves when using stable-baselines in OpenAI's gym?

I want to integrate my environment into the OpenAI's gym and then use the stable baselines library for training it. The learning method in the stable baseline is with one-line learning and you don't ...

reinforcement-learning open-ai gym

asked Apr 1 '20 at 10:48

Saeid Ghafouri

1434 bronze badges

1

vote

0answers

33 views

How should I avoid illegal states in OpenAI's gym?

I'm trying to make a gym environment for a simulation problem. In my gym environment, I have a set of illegal states which I don't want my agent to go into them. What is the easiest way to add such ...

reinforcement-learning open-ai gym

asked Apr 1 '20 at 10:01

Saeid Ghafouri

1434 bronze badges

2

votes

0answers

93 views

Pre-trained Models for Topic Modelling Transfer Learning (LDA) [closed]

I've been searching online - and so far, I've been unable to find any publicly-accessible pre-trained models that can be used for LDA Topic Modeling - Transfer Learning. Can anyone share any resources ...

natural-language-processing tensorflow open-ai transfer-learning text-classification

asked Mar 11 '20 at 13:11

Ramsha Siddiqui

1212 bronze badges

1

vote

1answer

294 views

OpenAI spinning up convolutional networks with PPO [closed]

I am using pytorch version of PPO and I have image input that I need to process with convolutional neural networks, are there any examples on how to set up the network? I know that stable baselines ...

reinforcement-learning open-ai

asked Feb 23 '20 at 0:53

Visgean Skeloru

1112 bronze badges

4

votes

1answer

413 views

How to define an action space when an agent can take multiple sub-actions in a step?

I'm attempting to design an action space in OpenAI's gym and hitting the following roadblock. I've looked at this post which is closely related but subtly different. The environment I'm writing needs ...

reinforcement-learning ai-design open-ai gym

asked Feb 19 '20 at 7:40

Seyed Moein Ayyoubzadeh

955 bronze badges

4

votes

1answer

47 views

Is a neural network able to optimize itself for speed?

I am experimenting with OpenAI Gym and reinforcement learning. As far as I understood, the environment is waiting for the agent to make a decision, so it's a sequential operation like this: ...

neural-networks reinforcement-learning open-ai markov-property

asked Jan 31 '20 at 8:14

Thomas Weller

2012 silver badges7 bronze badges

2

votes

2answers

259 views

Simulating successful trajectories in Montezuma's Revenge turns out to be unsuccessful

I have written code in OpenAI's gym to simulate a random playing in Montezuma's Revenge where the agent randomly samples actions from the action space and tries to play the game. A success for me is ...

reinforcement-learning open-ai rewards gym

asked Jan 27 '20 at 6:04

vikram71198

913 bronze badges

5

votes

1answer

943 views

How powerful is OpenAI's Gym and Universe in board games area?

I'm a big fan of computer board games and would like to make Python chess/go/shogi/mancala programs. Having heard of reinforcement learning, I decided to look at OpenAI Gym. But first of all, I would ...

reinforcement-learning open-ai chess gym go

asked Jan 26 '20 at 10:20

Taissa

633 bronze badges

0

votes

1answer

46 views

Why is this deep Q agent constantly learning just one action?

I'm trying to implement deep q learning in the OpenAI's gym "Taxi-v3" environment. But my agent only learns to do one action in every state. What am I doing wrong? Here is the Github repository with ...

deep-learning reinforcement-learning open-ai pytorch gym

asked Jan 16 '20 at 8:12

Voß

1098 bronze badges

1

vote

1answer

353 views

Are there OpenAI Gym continuing environments (other than inverted pendulum) and baselines?

I would like to use OpenAI Gym to solve a continuing environment, that is, a problem with a single, never-ending episode (please note I don't mean a continuous environment with continuous state and ...

reinforcement-learning open-ai gym

asked Dec 5 '19 at 3:25

user118967

1774 bronze badges

1

vote

0answers

37 views

Same implementation, but agent is not learning in Retro Pong Environment

I tried to implement the exact same python coding by Andrej Karpathy to train RL agent to play Pong, except that I migrated the environment from Gym to Retro. Everything is the same except the action ...

neural-networks reinforcement-learning python open-ai

asked Nov 19 '19 at 2:32

Hoo

211 bronze badge

3

votes

1answer

264 views

Can OpenAI simulations be used in real world applications?

I know that classical control systems have been used to solve the problem of the inverted pendulum - inverted pendulum. But I've seen that people have also used machine learning techniques to solve ...

machine-learning reinforcement-learning applications open-ai control-theory

asked Nov 18 '19 at 14:59

blazingcannon

612 bronze badges

0

votes

1answer

67 views

Do algorithms like OpenAI's "think up strategies"?

I was discussing with a friend whether current AI does anything remotely similar to 'thinking' and he argued that AIs that play games must think up strategies. While thinking may not be precisely ...

deep-learning philosophy game-ai agi open-ai

asked Nov 13 '19 at 12:52

Frans Rodenburg

1464 bronze badges

1

vote

0answers

26 views

How am I getting same results 30 times faster than in original HER paper?

I am reproducing the results from Hindsight Experience Replay by Andrychowicz et. al. In the original paper they present the results below, where the agent is trained for 200 epochs. 200 epochs * 800 ...

deep-learning reinforcement-learning open-ai

asked Oct 31 '19 at 7:00

rrz0

2331 silver badge6 bronze badges

1

vote

0answers

79 views

Getting score values from openai gym rom

I am using the SpaceInvaders-ram-v0 from OpenAI gym. I want to extract the game's current score using the RAM values. How do I get it? I tried doing some research ...

game-ai open-ai gym atari-games

asked Oct 7 '19 at 9:16

BBloggsbott

112 bronze badges

0

votes

0answers

82 views

DQN unlearns certain OpenAI-Gym environments

I solved the OpenAI-Gym MountainCar-v0 environment using dqn(using low-state-dimensional input). When I used the same code for solving CartPole-v0 environment, the network got trained in the reverse ...

reinforcement-learning dqn deep-rl open-ai

asked Sep 21 '19 at 5:48

Khush Agrawal

514 bronze badges

Questions tagged [open-ai]

Related Tags