I'm having difficulty picturing how models and policies are represented. Could someone describe how they would look in the context/environment of a game of Tic Tac Toe? For example, "In Tic Tac Toe, the policy would be how the agent decides in which position to place its token"(?) Equally, how model-free and off-policy would look in a TTT environment.
Using the same environment of TTT, could you also give examples of the differences between discrete and continuous Action Space, as well as State Space.