Questions tagged [advantage-actor-critic]
For questions related to the advantage actor-critic algorithms (that is, actor-critic algorithms that use the "advantage" function).
5
questions with no upvoted or accepted answers
3
votes
0answers
428 views
Implementation of PPO - Value Loss not converging, return plateauing
Copy from my reddit post:
(Sorry if this does not fit here, please tell me and i delete it)
Help regarding
I'm working on an implementation of PPO, which i plan to use in my (Bachelors) Thesis. To ...
2
votes
0answers
49 views
Problems with gradient-biased actor critic methods
To my knowledge, there are at least 6 different variants of Actor Critic:
\begin{array}{l l l l}
\text{actor gradient} & \text{critic gradient} & \text{actor gradient biased} & \text{name} ...
1
vote
0answers
31 views
What is the difference between step_model and train_model in the OpenAI implementation of the A2C algorithm?
I'm struggling a little with understanding the OpenAI implementation of A2C in the baselines (version 2.9.0) package. From my understanding, one ...
0
votes
0answers
11 views
A2C value function outputs keep increasing
I was implementing the A2C algorithm with as close to baseline setup as possible, and this is the code I came up with. The problem is that even after multiple rechecks, the program isn't showing ...
0
votes
0answers
26 views
How can I compare the results of AC1 with the results of A3C (on the CartPole environment)?
I am implementing A3C for the CartPole environment. I want to compare the results I got from A3C with the ones I got from AC1. The problem is I don't know which process to look at. If I use, let's say,...
