# Tag Info

## Hot answers tagged discrete-action-spaces

Accepted

### How to implement a variable action space in Proximal Policy Optimization?

The most straightforward solution is to simply make every action "legal", but implementing a consistent, deterministic mapping from potentially illegal actions to different legal actions. Whenever the ...
• 10.2k
Accepted

### What techniques are used to make MDP discrete state space manageable?

tl:dr Read chapter 9 of an Introduction of Reinforcement Learning There is definitely a problem (a curse if you will) when the dimensionality of a task (MDP) grows. For fun, lets extend your problem ...
• 3,817
Accepted

### Can a large discrete action space be represented using Gaussian distributions?

The answer is "it depends". Once you have arranged the actions into order, a key trait is whether the action value function has a simple enough shape that sampling from a Gaussian policy ...
• 31.7k

### How to implement a variable action space in Proximal Policy Optimization?

Change the action space at each step, depending on the internal_state. I assume this is nonsense. Yes, this seems overkill and makes the problem unnecessarily complex, there could be other things ...
1 vote
Accepted

### Model-based RL algorithms for continuous state space and finite action space

In optimal control field to minimize certain well-defined costs especially in process industries, continuous state space model-based planning methods such as model predictive control (MPC) is a common ...
• 1,288
1 vote

### Is there a multi-agent deep reinforcement learning algorithm which is for environments with only discrete action spaces (Not hybrid)?

A natural policy to act in an environment with discrete action space would be a softmax. This paper describes a method that uses the idea of centralized training, and I believe could be used in your ...
• 103
1 vote

### How to implement a variable action space in Proximal Policy Optimization?

Normally, the set of actions that the agent can execute does not change over time, but some actions can become impossible in different states (for example, not every move is possible in any position ...

Only top scored, non community-wiki answers of a minimum length are eligible