I am trying to mathematically characterize the finite sample convergence rates for Q-learning. To this end, I have read the following papers

In the latter, they introduce a rather simple approach that seems appealing to me; however, they only sketch it for phased Q-learning.

I would be interested in knowing about any source where I could find the same approach modified for standard Q-learning; in section 4 of the paper, they claim that

all of our results can be generalized to apply to standard Q-learning

Moreover, if you feel I am missing any paper that could be of interest with regards to the finite sample convergence of Q-learning, I would greatly appreciate it if you could post the name of it.


Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.