Questions tagged [continuous-state-spaces]

For questions about continuous state spaces, in the context of reinforcement learning or other AI sub-fields.

Filter by
Sorted by
Tagged with
1 vote
1 answer
53 views

Reinforcement learning algorithms for large problems that are not based on a neural network

I have a large control problem with multidimensional continuous inputs (13) and outputs (3). I tried several Reinforcement learning algorithms like Deep-Q-Networks (DQN), Proximal Policy Optimization (...
user avatar
  • 213
0 votes
0 answers
21 views

Can you apply TRPO to a problem involving a continuous state space and justify it theoretically?

I am currently reading and trying to understand the theory behind TRPO, i.e. sections 2 and 3 from the paper here. Ultimately, I want to apply PPO to do a (single) stock trading task using the FinRL ...
user avatar
0 votes
0 answers
34 views

Training a RL agent using different data at each episode

I am training a RL agent whose state is composed of two numbers, ranging between 4 ~ 16 and 0 ~ 360. The action is continuous and between 0~90. In real life, the states can be any I am training a TD3 ...
user avatar
  • 49
0 votes
0 answers
75 views

What do we actually 'approximate' when dealing with large state spaces in Q-learning?

I realized that my state space is very large in size. I had planned to use tabular Q-learning (Bellman equation to update the $Q(s, a)$ after each action taken). But this 'large space' realization has ...
user avatar
2 votes
1 answer
469 views

Can neural networks have continuous inputs and outputs, or do they have to be discrete?

In general, can ANNs have continuous inputs and outputs, or do they have to be discrete? So, basically, I would like to have a mapping of continuous inputs to continuous outputs. Is this possible? ...
user avatar
  • 213
1 vote
0 answers
23 views

Is there a gentle introduction to reinforcement learning applied to MDPs with continuous state spaces?

I am looking for a gentle introduction (videos, lecture notes, tutorials, books) on reinforcement learning (MDPs) involving continuous states (or very large cardinality of state space). In particular, ...
user avatar
  • 175
15 votes
2 answers
9k views

Can Q-learning be used for continuous (state or action) spaces?

Many examples work with a table-based method for Q-learning. This may be suitable for a discrete state (observation) or action space, like a robot in a grid world, but is there a way to use Q-learning ...
user avatar
1 vote
0 answers
89 views

How to generalize finite MDP to general MDP?

Suppose, for simplicity sake, to be in a discrete time domain with the action set being the same for all states $S \in \mathcal{S}$. Thus, in a finite Markov Decision Process, the sets $\mathcal{A}$, $...
user avatar