What is the exact meaning of this expression? I'm unsure on the notation. I believe E[R(s)] is expected value of reward of state s, but I'm unsure what the subscript under the E means.

enter image description here

  • $\begingroup$ Since it would not be helpful for someone to explain something you already know and understand, can you edit to be specific about what part of the notation is unclear to you? $\endgroup$
    – Sycorax
    Commented Oct 14, 2023 at 18:24
  • $\begingroup$ Thanks for the suggestion. I edited my question $\endgroup$
    – Ryan Marr
    Commented Oct 14, 2023 at 18:57
  • $\begingroup$ Great, I think that will help future readers answer this. One more tip is that you can use math typesetting on your posts. More information: math.meta.stackexchange.com/questions/5020/… $\endgroup$
    – Sycorax
    Commented Oct 14, 2023 at 19:11


You must log in to answer this question.

Browse other questions tagged .