Skip to main content
A few improvements
Source Link
nbro
  • 41.4k
  • 12
  • 114
  • 205

I was reading in the article A tutorial on partially observable Markov decision processes (p. 120), by Michael L.Littman Littman, that $\sum_{z \in Z}O(a, s',z) =1$, with:

where $a$ =is the action

 , $s'$= the next possible state

  and $z$ = a certain/specific observation.

How come that the observation function $O(a, s', z)$ adds up to $1$ in POMDP?

To me it is like there is always a way to capture a state in POMDP. But it should be not since the states are only partially observable.

I was reading in the article A tutorial on partially observable Markov decision processes (p. 120), by Michael L.Littman, that $\sum_{z \in Z}O(a, s',z) =1$, with:

$a$ = action

 $s'$= next possible state

 $z$ = a certain/specific observation

How come that the observation function $O(a, s', z)$ adds up to $1$ in POMDP?

To me it is like there is always a way to capture a state in POMDP. But it should be not since the states are only partially observable.

I was reading in the article A tutorial on partially observable Markov decision processes (p. 120), by Michael L. Littman, that $\sum_{z \in Z}O(a, s',z) =1$, where $a$ is the action, $s'$ the next possible state and $z$ a certain/specific observation.

How come that the observation function $O(a, s', z)$ adds up to $1$ in POMDP?

added 106 characters in body; edited tags
Source Link
nbro
  • 41.4k
  • 12
  • 114
  • 205

I was reading in the article A tutorial on partially observable Markov decision processes (p. 120), by Michael L.Littman, that $\sum_{z \in Z}O(a, s',z) =1$, with:

$a$ = action

$s'$= next possible state

$z$ = a certain/specific observation

How come that the observation function $O(a, s', z)$ adds up to $1$ in POMDP?

To me it is like there is always a way to capture a state in POMDP. But it should be not since the states are only partially observable.

Source: https://www.sciencedirect.com/science/article/abs/pii/S0022249609000042 p.120

I was reading that $\sum_{z \in Z}O(a, s',z) =1$, with:

$a$ = action

$s'$= next possible state

$z$ = a certain/specific observation

How come that the observation function $O(a, s', z)$ adds up to $1$ in POMDP?

To me it is like there is always a way to capture a state in POMDP. But it should be not since the states are only partially observable.

Source: https://www.sciencedirect.com/science/article/abs/pii/S0022249609000042 p.120

I was reading in the article A tutorial on partially observable Markov decision processes (p. 120), by Michael L.Littman, that $\sum_{z \in Z}O(a, s',z) =1$, with:

$a$ = action

$s'$= next possible state

$z$ = a certain/specific observation

How come that the observation function $O(a, s', z)$ adds up to $1$ in POMDP?

To me it is like there is always a way to capture a state in POMDP. But it should be not since the states are only partially observable.

edited body; edited tags; edited title
Source Link
nbro
  • 41.4k
  • 12
  • 114
  • 205

Does the observation function for Partially Observable MDPPOMDP always add up to 1?

I was reading that $\sum_{z \in Z}O(a, s',z) =1$, with:

$a$ = action

$s'$= next possible state

$z$ = a certain/specific observation

How comescome that the observation function O(a, s', z)$O(a, s', z)$ adds up to 1$1$ in POMDP?

To me it is like there is always a way to capture a state in POMDP. But it should be not since the states are only partially observable.

Source: https://www.sciencedirect.com/science/article/abs/pii/S0022249609000042 p.120

Does the observation function for Partially Observable MDP always add up to 1

I was reading that $\sum_{z \in Z}O(a, s',z) =1$, with:

$a$ = action

$s'$= next possible state

$z$ = a certain/specific observation

How comes that the observation function O(a, s', z) adds up to 1 in POMDP?

To me it is like there is always a way to capture a state in POMDP. But it should be not since the states are only partially observable.

Source: https://www.sciencedirect.com/science/article/abs/pii/S0022249609000042 p.120

Does the observation function for POMDP always add up to 1?

I was reading that $\sum_{z \in Z}O(a, s',z) =1$, with:

$a$ = action

$s'$= next possible state

$z$ = a certain/specific observation

How come that the observation function $O(a, s', z)$ adds up to $1$ in POMDP?

To me it is like there is always a way to capture a state in POMDP. But it should be not since the states are only partially observable.

Source: https://www.sciencedirect.com/science/article/abs/pii/S0022249609000042 p.120

Source Link
Bryan McGill
  • 471
  • 1
  • 3
  • 12
Loading