7 votes

How to implement a variable action space in Proximal Policy Optimization?

The most straightforward solution is to simply make every action "legal", but implementing a consistent, deterministic mapping from potentially illegal actions to different legal actions. Whenever the ...
Dennis Soemers's user avatar
  • 10.2k
6 votes

What techniques are used to make MDP discrete state space manageable?

tl:dr Read chapter 9 of an Introduction of Reinforcement Learning There is definitely a problem (a curse if you will) when the dimensionality of a task (MDP) grows. For fun, lets extend your problem ...
Jaden Travnik's user avatar
4 votes

Can a large discrete action space be represented using Gaussian distributions?

The answer is "it depends". Once you have arranged the actions into order, a key trait is whether the action value function has a simple enough shape that sampling from a Gaussian policy ...
Neil Slater's user avatar
  • 31.7k
2 votes

How to implement a variable action space in Proximal Policy Optimization?

Change the action space at each step, depending on the internal_state. I assume this is nonsense. Yes, this seems overkill and makes the problem unnecessarily complex, there could be other things ...
Jithendaraa Subramanian's user avatar
1 vote

Model-based RL algorithms for continuous state space and finite action space

In optimal control field to minimize certain well-defined costs especially in process industries, continuous state space model-based planning methods such as model predictive control (MPC) is a common ...
cinch's user avatar
  • 1,288
1 vote

Is there a multi-agent deep reinforcement learning algorithm which is for environments with only discrete action spaces (Not hybrid)?

A natural policy to act in an environment with discrete action space would be a softmax. This paper describes a method that uses the idea of centralized training, and I believe could be used in your ...
Felipe Costa's user avatar
1 vote

How to implement a variable action space in Proximal Policy Optimization?

Normally, the set of actions that the agent can execute does not change over time, but some actions can become impossible in different states (for example, not every move is possible in any position ...
madpower2000's user avatar

Only top scored, non community-wiki answers of a minimum length are eligible