Questions tagged [a3c]
For questions related to the asynchronous advantage actor-critic (A3C) algorithm.
13
questions
-1
votes
0answers
23 views
How to find Action in an Actor Critic Method with infinite possible actions
I am working on an Actor-Critic Method where there are infinite numbers of possible actions (let’s say movement of a robot, where the possible movement is not just left-right-up-down but every ...
0
votes
0answers
28 views
How can I compare the results of AC1 with the results of A3C (on the CartPole environment)?
I am implementing A3C for the CartPole environment. I want to compare the results I got from A3C with the ones I got from AC1. The problem is I don't know which process to look at. If I use, let's say,...
1
vote
0answers
41 views
Understanding loss function gradient in asynchronous advantage actor-critic (A3C) algorithm
This is a question I posted here. I am asking it on this StackExchange branch as well, so that more people who could potentially answer get to see the question.
In the A3C algorithm from the original ...
1
vote
1answer
319 views
How do I create a custom gym environment based on an image?
I am trying to create my own gym environment for the A3C algorithm (one implementation is here). The custom environment is a simple login form for any site. I want to create an environment from an ...
0
votes
1answer
49 views
Why would the reward of A3C with LSTM suddenly drop off after many episodes?
I am training an A3C with stacked LSTM.
During initial training, my model was giving descent +ve reward. However, after many episodes, its reward just goes to zero and is continuing for a long time. ...
1
vote
0answers
23 views
is it ok to take random actions while training a3c as in below code
i am trying to train an A3C algorithm but I am getting same output in the multinomial function.
can I train the A3C with random actions as in below code.
can someone expert comment.
...
1
vote
0answers
37 views
When past states contain useful information, does A3C perform better than TD3, given that TD3 does not use an LSTM?
I am trying to build an AI that needs to have some information about the past states as well. Therefore, LSTMs are suitable for this.
Now, I want to know that for a problem/game like Breakout, where ...
1
vote
1answer
657 views
Why do we also need to normalize the action's values on continuous action spaces?
I was reading here tips & tricks for training in DRL and I noticed the following:
always normalize your observation space when you can, i.e., when you know the boundaries
normalize your ...
5
votes
1answer
294 views
How does being on-policy prevent us from using the replay buffer with the policy gradients?
One of the approaches to improving the stability of the Policy
Gradient family of methods is to use multiple environments in
parallel. The reason behind this is the fundamental problem we
discussed in ...
1
vote
0answers
103 views
How should I deal with variable batch size in A3C?
I am fairly new to reinforcement learning (RL) and deep RL. I have been trying to create my first agent (using A3C) that selects an optimal path with the reward being some associated completion time (...
0
votes
2answers
309 views
Why I got the same action when testing the A2C?
I'm working on an advantage actor-critic (A2C) reinforcement learning model, but when I test the model after I trained for 3500 episodes, I start to get almost the same action for all testing episodes....
3
votes
1answer
98 views
What is the pros and cons of increasing and decreasing the number of worker processes in A3C?
In A3C, there are several child processes and one master process. The child precesses calculate the loss and backpropagation, and the master process sums them up and updates the parameters, if I ...
4
votes
0answers
83 views
Can deep successor representations be used with the A3C algorithm?
Deep Successor Representations(DSR) has given better performance in tasks like navigation, when compared to normal model-free RL tasks. Basically, DSR is a hybrid of model-free RL and model-based RL. ...