Consider the actor-critic reinforcement learning setting (actor and critic parameterized by a neural network). The reward is given only at the end of the episode (or when there is a timeout there is no reward). How
How could we learn the value function? Do you recommend computing intermediate rewards?