Questions tagged [continuous-tasks]

For questions that involve continuous/continuing tasks/problems/environments in reinforcement learning.

Filter by
Sorted by
Tagged with
3 votes
0 answers
33 views

Algorithms for average reward reinforcement learning in continuous/general state-action space

I see that discounted reward reinforcement learning has been extensively studied in the literature. However, the average reward metric receives less attention, and it looks like algorithms for this ...
k2pctdn's user avatar
  • 55
2 votes
0 answers
434 views

Why are agents trained in episodes, even in non-episodic tasks?

Let's consider some non-episodic problem. Maybe a game which can go on forever. My question is: Why are agents still trained in episodes? My understanding is that the agent's neural network is updated ...
Vladimir Belik's user avatar
2 votes
1 answer
465 views

For continuing tasks, is the choice of episode length completely arbitrary?

Let's say I'm training a reinforcement learning agent to act in some environment that perpetually continues to give the agent opportunities to earn rewards, and there is no cap on the score and there ...
Vladimir Belik's user avatar
1 vote
0 answers
42 views

Knowing the futility of discounting in continuing problems, how can we say discounting has no role in control problems with function approximation?

Sutton-Barto (Section 10.4, page 254): Based on the futility of discounting in continuing problems, how can we conclude that discounting has no role to play in control problems with function ...
user3489173's user avatar
1 vote
1 answer
130 views

Predicting continous value with CNN (prediction of fruit maturity)

I want to train some IA algorithm to be able to evaluate the maturity of a fruit (say, measured in numbers of days before rotten) based on an image of the fruit. My first instinct is to go with ...
Antoine Labelle's user avatar
6 votes
1 answer
1k views

What are the advantages of RL with actor-critic methods over actor-only methods?

In general, what are the advantages of RL with actor-critic methods over actor-only (or policy-based) methods? This is not a comparison with the Q-learning series, but probably a method of learning ...
ground clown's user avatar
2 votes
4 answers
2k views

How can the Cart Pole problem be a continuing task?

In Introduction to Reinforcement Learning (2nd edition) by Sutton and Barto, there is an example of the Pole-Balancing problem (Example 3.4). In this example, they write that this problem can be ...
user3595632's user avatar