Skip to main content
1 vote

Doesn't the n-step Tree Backup algorithm negatively affect the DQN-Agent by creating inconsistent look-ahead targets?

Hence, I think we would in general look only up to n-steps ahead rather than always n-steps, since the n consecutive samples from the replay buffer don't guarantee that the transitions happended ...
Neil Slater's user avatar
  • 32.7k
1 vote

How is $Q(s', a')$ calculated in SARSA and Q-Learning?

It seems that your problem is that you think that we must know the true value of $Q(s', a')$ in order to perform the SARSA update. This is not the case! SARSA is a reinforcement learning algorithm, ...
nbro's user avatar
  • 40.9k

Only top scored, non community-wiki answers of a minimum length are eligible