Questions tagged [episodic-tasks]

For questions related to episodic tasks in reinforcement learning, i.e. tasks that can be naturally divided into episodes (e.g. multiple games of tic-tac-toe, where each game would be an episode).

Filter by
Sorted by
Tagged with
1 vote
1 answer

Is it necessary to have a constant reward in the terminal state?

I have downloaded the grid world project form this link. I have executed the project multiple times using: python -k 20 -a q -r -0.2 -s 90 I have ...
AAA's user avatar
  • 111
1 vote
1 answer

PPO: dealing with variable episodic length

I'm dealing with a project that has episodes of variable length raging from just 3 steps to 20 steps. Now, I'm guessing that this may cause problems with GAE, as actions in large episodes will have ...
Antonis Karvelas's user avatar
0 votes
1 answer

Could Softmax Action Selection be useful to solve an episodic task with more than 100000 possible states and 2000 actions?

I am new in the field of RL. I am trying to use tabular methods, Q-Learning for solving a problem that takes a lot of time for computation, so I would like to know if there are more efficient methods ...
Aquila's user avatar
  • 33
2 votes
1 answer

Is it appropriate to represent 'total failure' as an absorbing state?

My understanding is that, in Markov decision processes, absorbing state are states which can transition only to themselves and that these transitions generate rewards of 0. I know that absorbing ...
K--'s user avatar
  • 121
3 votes
2 answers

In the on-policy state distribution for episodic tasks, why don't we take into account the length of the episode?

In Sutton & Barto's "Reinforcement Learning: An Introduction", 2nd edition, page 199, they describe the on-policy distribution for episodic tasks in the following box: I don't understand how this ...
user118967's user avatar
2 votes
4 answers

How can the Cart Pole problem be a continuing task?

In Introduction to Reinforcement Learning (2nd edition) by Sutton and Barto, there is an example of the Pole-Balancing problem (Example 3.4). In this example, they write that this problem can be ...
user3595632's user avatar