Questions tagged [transition-model]
For questions related to the transition model of a Markov decision process or other Markov models. This term is often used in reinforcement learning (RL) to distinguish between model-based and model-free RL algorithms, where model-based algorithms use the transition model while model-free don't use it.
1
question
1
vote
1
answer
512
views
How do you generate the transition probabilities of a non-trivial MDP?
I understand an MDP (Markov Decision Process) model is a tuple of $\{S, A, P, R \}$ where:
$S$ is a discrete set of states
$A$ is a discrete set of actions
$P$ is the transition matrix ie. $P(s' \mid ...