Is the following sentence correct?
The estimated values $Q(a)$ do not converge to the true values $q_*(a)$ because $\epsilon$-greedy action selection behaves randomly from time to time.
My Answer: The sentence is wrong since eventually the estimated value $Q(a)$ will converge to $q_*(a)$ and the randomness of epsilon greedy action selection won't be able to influence it if we run it for a long time. Is my answer correct?