For questions related to semi-Markov Decision Processes (SMDP).

For more info, have a look at the paper "Between MDPs and semi-MDPs: A framework for Temporal Abstraction in Reinforcement Learning" (by Richard S.Sutton, Doina Precup and Satinder Singh).