Skip to main content
3 of 4
edited tags; edited title
nbro
  • 41.4k
  • 12
  • 114
  • 205

Why does the definition of the reward function $r(s, a, s')$ involve the term $p(s' \mid s, a)$?

While reading about reinforcement learning, I have come across the following expression for expected rewards in terms of a summation, the denominator of which I am not able to account for.

The formula given is:

enter image description here

According to what I understand, the formula should have been correct without the denominator (that I have highlighted). How is this formula correct?

Source of image: Andrew G and Sutton's book on RL.