For questions related to the transition model of a Markov decision process or other Markov models. This term is often used in reinforcement learning (RL) to distinguish between model-based and model-free RL algorithms, where model-based algorithms use the transition model while model-free don't use it.
About
Synonyms
transition-functionStats
|
created |
3 years, 3 months ago |
|
viewed |
5 times |
|
editors |
1 |
Top Answerers
more »
Recent Hot Answers
What are the state space and the state transition function in AI?If the current state is $S_t$ and the actions are chosen according to $\pi$, what is the expectation of $R_{t+1}$ in terms of $\pi$ and $p$?
Is it appropriate to represent 'total failure' as an absorbing state?
How can we find the value function by solving a system of linear equations without knowing the policy?
How do compute the table for $p(s',r|s,a)$ (exercise 3.5 in Sutton & Barto's book)?
more »