> In order for the algorithm to have stable behavior, the replay buffer should be large enough to contain a wide range of experiences, but it may not always be good to keep everything.

The larger the experience replay, the less likely you will sample correlated elements. However, a large experience replay also requires a lot of memory. So, there is a trade-off between training stability (of the NN) and memory requirements.