New answers tagged action-spaces
1
do we also want to consider the subset of invalid actions for the $\max\limits_{a}Q(s_{t+1},a)$
No.
Doing so would go against the theory behind the Bellman equation from which the update derives. The value of $r_{t+1} + \gamma \max\limits_{a'}Q(s_{t+1},a')$ needs to match to a realisable trajectory, otherwise the eventual expected values may be estimates ...
Top 50 recent answers are included