I am currently implementing this paper in Python. While reading about the reward scheme I came across the following:
Finally, the proposed reward scheme implicitly considers the number of steps as a cost because of the way in which Q-learning models the discount of future rewards (positive and negative).
How would you implement this "Number of Steps" cost? I am keeping track of the number of steps that have been taken, therefore would it be best to use an exponential functions to discount the reward at the current time step?
If anyone has a good idea or knows the standard in regard to this I would love to hear your thoughts.