I was reading about the temporal difference (TD) learning and I read that:
TD handles continuing, non-episodic domains
Assuming that continuing means non-terminating, what does non-episodic or episodic domain mean?
Artificial Intelligence Stack Exchange is a question and answer site for people interested in conceptual questions about life and challenges in a world where "cognitive" functions can be mimicked in purely digital environment. It only takes a minute to sign up.
Sign up to join this communityI was reading about the temporal difference (TD) learning and I read that:
TD handles continuing, non-episodic domains
Assuming that continuing means non-terminating, what does non-episodic or episodic domain mean?
Assuming that continuing means non terminating, what does non-episodic or episodic domain mean ?
Non-episodic means the same as continuing. The quote you found is not listing two separate domains, the word "continuing" is slightly redundant. I expect the author put it in there to emphasise the meaning, or to cover two common ways of describing such environments.
Episodic domain problems are ones that terminate, or otherwise naturally split into groups of time steps that can be considered separately.