Questions tagged [time-step]

For questions related to the concept of time-step, for instance, in Markov decision processes or reinforcement learning.

Filter by
Sorted by
Tagged with
7
votes
2answers
2k views

What is a time-step in a Markov Decision Process?

The "discounted sum of future rewards" (or return) using discount factor $\gamma$ is $$\gamma^1 r_1 +\gamma^2 r_2 + \gamma^3 r_2 + \dots \tag{1}\label{1}$$ where $r_i$ is the reward received ...