Questions tagged [ergodicity]

For questions related to the concept of ergodicity, which occurs, for example, in the context of reinforcement learning and Markov decision processes.

Filter by
Sorted by
Tagged with
8 votes
1 answer
3k views

What is ergodicity in a Markov Decision Process (MDP)?

I have read about the concept of ergodicity on the safe RL paper by Moldovan (section 3.2) and the RL book by Sutton (chapter 10.3, 2nd paragraph). The first one says that "a belief over MDPs is ...
josealeixo.pc's user avatar