Questions tagged [open-ai]

For questions related to the openAI, including the Gym toolkit.

Filter by
Sorted by
Tagged with
-1
votes
0answers
45 views

Is GPT-3 better than what DeepMind could do?

So there is this tremendous hype about GPT-3, which is in fact impressive. But I've been always convinced that DeepMind was by far the leader in machine learning. However, I didn't find any comparable ...
1
vote
0answers
57 views

Most of state-action pairs remain unvisited in the q-table

In building my first Q-learning algorithm for OpenAI gym's CartPole problem, many of my states remain unvisited. I believe it is the reason that my agent does not learn. Can I be told of the reasons I ...
1
vote
0answers
49 views

OpenAI gym's CartPole problem system does not learn

My OpenAI CartPole-v0 problem's implementation using basic Q-learning does not learn at all. I am a beginner and have implemented my first ever Q-learning from scratch after learning from tutorials. ...
3
votes
1answer
98 views

What exactly are the “parameters” in GPT-3's 175 billion parameters and how are they chosen/generated?

When I studied neural networks, parameters were learning rate, batch size etc. But even GPT3's ArXiv paper does not mention anything about what exactly the parameters are, but gives a small hint that ...
3
votes
0answers
102 views

Why is GPT-3 such a game changer?

I've been hearing a lot about GPT-3 by OpenAI, and that it's a simple to use API with text in text out and has a big neural network off 175B params. But how did they achieve this huge number of ...
0
votes
1answer
43 views

How can I change observation states' values in OpenAI gym's cartpole environment?

I am learning with the OpenAI gym's cart pole environment. I want to make the observation states discrete (with small stepsize) and for that purpose, I need to change two of the observations from [$ -\...
1
vote
0answers
32 views

How can I convert a simple CLI RPG to a compatible environment for training an RL agent via stable-baselines?

What would be the good choice of algorithm to use for character action selection in an RPG, implemented in Python? I had previously asked this question in the hopes of getting headway on the AI ...
0
votes
1answer
42 views

How do I test an LSTM-based reinforcement learning model using any Atari games in OpenAI gym?

I am writing a couple of different reinforcement learning models based on Rainbow DQN or some PG models. All of them internally use an LSTM network because my project is using time series data. I ...
0
votes
0answers
30 views

Using deep deterministic policy gradient in OpenAI Gym to solve problems with continuous actions

I am trying to do the following: Install the OpenAI baseline algorithms from the following GitHub repository: github.com/openai/baselines by following the instructions in the readme file. Train an ...
1
vote
1answer
51 views

Is there a general file type associated with AI projects?

This is a general question. Is there a general file type associated with AI projects? Photoshop = .psd Excel = csv Artificial Intelligence = ?
0
votes
1answer
35 views

How to add more than 1 agent in one generation with Q Learning

Sometimes the agent learns a bit slow and you want to have multiple agents in one generation. And at each episode you'll draw on the screen only the best of them or all of them. How is that possible? ...
2
votes
1answer
57 views

What should the action space for the card game Crib be?

I'm working on creating an environment for a card game, which the agent chooses to discard certain cards in the first phase of the game, and uses the remaining cards to play with. (The game is Crib if ...
1
vote
1answer
41 views

Can we combine Off-Policy with On-Policy Algorithms?

On-Policy Algorithms like PPO directly maximize the performance objective or an approximation of it. They tend to be quite stable and reliable but are often sample inefficient. Off-Policy Algorithms ...
1
vote
0answers
31 views

State-of-the-art algorithms not working on a custom RL environment

I'm trying to train a RL agent on a custom, highly stochastic environment (MDP). In order to do so I'm using existing implementations of state-of-the-art RL algorithms as provided by Stable Baselines. ...
0
votes
0answers
56 views

OpenAI Gym: Multiple actions in one step

I'm trying to design an OpenAI Gym environment in which multiple users/players perform actions over time. It's round based and each user needs to take an action before the round is evaluated and the ...
1
vote
0answers
42 views

How do i start building an autoclick bot for pubg mobile?

I want to make a bot which clicks the fire button on the mobile screen upon seeing an enemies head. In pubg mobile which is an android game you have to control the fire button and the aim along with ...
1
vote
0answers
30 views

How to integrate dict space of OpenAI gym into a reinforcement learning framework?

I am implementing a gym environment and I have several input arrays as my input (different sizes). The most simple method to integrate my environment into the gym is to use the dict space as my ...
2
votes
0answers
49 views

How to formulate normalization/probability conditions on state-action spaces in Gym?

I intend to develop a custom environment for open-ai's gym. My goal is for an agent to learn (among additional objectives) dividing a certain quantity drawn from a continous action space (i.e. spaces....
1
vote
0answers
30 views

How to define observation and action space for an array-like input?

I am working on a problem, and I want to implement it as a reinforcement learning problem and integrate it into the OpenAI's gym. My states are in the form of lists of length $n$, where each element ...
1
vote
0answers
29 views

How can I add logic for invalid moves when using stable-baselines in OpenAI's gym?

I want to integrate my environment into the OpenAI's gym and then use the stable baselines library for training it. The learning method in the stable baseline is with one-line learning and you don't ...
1
vote
0answers
26 views

How should I avoid illegal states in OpenAI's gym?

I'm trying to make a gym environment for a simulation problem. In my gym environment, I have a set of illegal states which I don't want my agent to go into them. What is the easiest way to add such ...
2
votes
0answers
39 views

Pre-trained Models for Topic Modelling Transfer Learning (LDA)

I've been searching online - and so far, I've been unable to find any publicly-accessible pre-trained models that can be used for LDA Topic Modeling - Transfer Learning. Can anyone share any resources ...
0
votes
0answers
21 views

Stable baseline learn from online game

i created a custom environment for an online game. i want to know how can i train my model with stable baseline because learn function in stable baseline just take number of steps and in online game ...
1
vote
1answer
66 views

OpenAI spinning up convolutional networks with PPO

I am using pytorch version of PPO and I have image input that I need to process with convolutional neural networks, are there any examples on how to set up the network? I know that stable baselines ...
3
votes
0answers
76 views

How to define an action space when an agent can take multiple sub-actions in a step?

I'm attempting to design an action space in OpenAI's gym and hitting the following roadblock. I've looked at this post which is closely related but subtly different. The environment I'm writing needs ...
2
votes
0answers
32 views

Is a neuronal network able to optimize itself for speed?

I am experimenting with OpenAI Gym and reinforcement learning. As far as I understood, the environment is waiting for the agent to make a decision, so it's a sequential operation like this: ...
2
votes
2answers
190 views

Simulating successful trajectories in Montezuma's Revenge turns out to be unsuccessful

I have written code in OpenAI's gym to simulate a random playing in Montezuma's Revenge where the agent randomly samples actions from the action space and tries to play the game. A success for me is ...
4
votes
1answer
237 views

How powerful is OpenAI's Gym and Universe in board games area?

I'm a big fan of computer board games and would like to make Python chess/go/shogi/mancala programs. Having heard of reinforcement learning, I decided to look at OpenAI Gym. But first of all, I would ...
0
votes
1answer
42 views

Why is this deep Q agent constantly learning just one action?

I'm trying to implement deep q learning in the OpenAI's gym "Taxi-v3" environment. But my agent only learns to do one action in every state. What am I doing wrong? Here is the Github repository with ...
1
vote
1answer
124 views

Are there OpenAI Gym continuing environments (other than inverted pendulum) and baselines?

I would like to use OpenAI Gym to solve a continuing environment, that is, a problem with a single, never-ending episode (please note I don't mean a continuous environment with continuous state and ...
1
vote
0answers
24 views

Same implementation, but agent is not learning in Retro Pong Environment

I tried to implement the exact same python coding by Andrej Karpathy to train RL agent to play Pong, except that I migrated the environment from Gym to Retro. Everything is the same except the action ...
3
votes
1answer
96 views

Can OpenAI simulations be used in real world applications?

I know that classical control systems have been used to solve the problem of the inverted pendulum - inverted pendulum. But I've seen that people have also used machine learning techniques to solve ...
0
votes
1answer
57 views

Do algorithms like OpenAI's “think up strategies”?

I was discussing with a friend whether current AI does anything remotely similar to 'thinking' and he argued that AIs that play games must think up strategies. While thinking may not be precisely ...
1
vote
0answers
25 views

How am I getting same results 30 times faster than in original HER paper?

I am reproducing the results from Hindsight Experience Replay by Andrychowicz et. al. In the original paper they present the results below, where the agent is trained for 200 epochs. 200 epochs * 800 ...
2
votes
1answer
42 views

What is the difference between success rate and reward when dealing with binary and sparse rewards?

In OpenAI Gym reward is defined as: reward (float): amount of reward achieved by the previous action. The scale varies between environments, but the goal is ...
1
vote
0answers
39 views

Getting score values from openai gym rom

I am using the SpaceInvaders-ram-v0 from OpenAI gym. I want to extract the game's current score using the RAM values. How do I get it? I tried doing some research ...
0
votes
0answers
40 views

DQN unlearns certain OpenAI-Gym environments

I solved the OpenAI-Gym MountainCar-v0 environment using dqn(using low-state-dimensional input). When I used the same code for solving CartPole-v0 environment, the network got trained in the reverse ...
1
vote
1answer
26 views

Is there a train simulator with scripting interface?

Artificial Intelligence is usually teached with robotics in mind. The problem with car like robots is, that the amount of control which is needed is huge. A car has a position, a speed value, a ...
2
votes
1answer
940 views

Has anyone been able to solve OpenAI's hardcore bipedal walker with their implementation of DDPG?

As the question suggests, I'm trying to see if I can solve OpenAI's hardcore version of their gym's bipedal walker using OpenAI's DDPG algorithm. Below is a performance graph from my latest attempt, ...
2
votes
0answers
57 views

What is a high performing network architecture to use in a PPO2 MlpLnLstmPolicy RL model?

I am playing around with creating custom architectures in stable-baselines. Specifically I am training an agent using a PPO2 model. My question is, are there some rules of thumb or best practices in ...
1
vote
0answers
94 views

Understanding policy update in PPO2

I have a question regarding the functionality of the PPO2 algorithm together with the Stable Baselines implementation: From the original paper I know that the policy parameters $\theta$ are updated K-...
0
votes
1answer
553 views

OpenAI Spinning Up: Breakout-v0 example

I haven't been able to find any assistance / examples which could help me implement OpenAI's Spinning Up resource to solve Atari's Breakout-v0 game in the OpenAI gym. I simply want to know why the ...
1
vote
1answer
208 views

OpenAI Gym interface when reward calculation is delayed? (continuous control with considerable reaction time)

I'm about to create an OpenAI Gym environment for a flight simulator. I'm wondering, how to cope with the fact, that the result and reward for some action needs a considerable time to advance through ...
1
vote
1answer
419 views

Advice on creating a new environment using OpenAI Gym

I'm looking for some general advice here before I dive in. I'm interested in creating a new environment for OpenAI gym to provide some slightly more challenging continuous control problems than the ...
3
votes
0answers
25 views

Is it possible to insert a new map in the OpenAI Gym Taxi V.2?

I would like to train a neural network with the OpenAI Gym Taxi and see how it would react on a new map. Is it possible to insert a new map in the OpenAI Gym Taxi V.2?
1
vote
0answers
256 views

Difficulty in balancing Pendulum using Deep Reinforcement Learning Algorithm

I am using OpenAI Gym framework for reinforcement learning where I am trying solve classic control problem of balancing an Inverted Pendulum, which is similar to the "Pendulum-v0" with some changes in ...
2
votes
1answer
275 views

Bachelor thesis in reinforcement learning

I've decided to make my bachelor thesis in RL. I am currently struggling in finding a proper problematic. I am interested in multi-agent RL with the dilemma between selfishness and cooperation. I ...
4
votes
0answers
83 views

How did the OpenAI 5 for Dota concatenate units?

I am no expert in the field of AI so I apologize if this is a simple/easy question. I was trying to implement a network similar to OpenAI's for another game and I noticed that I did not fully ...
1
vote
2answers
84 views

Running 2 NEAT nets on the same observations

So i have been playing around with neat-python. I made a program, applying neat, to play pinball on the Atari 2600. The code for that can be found in the file ...
1
vote
1answer
81 views

OpenAI-Gym excess of actions

I'm trying to replicate the DeepMind DQN paper, and actually I'm using the OpenAI-Gym enviroment. I'm trying to get a decent score with Space Invaders (using ...