I would like to shore up my interpretation of the concept of "batch size".

It is my understanding that in Vanilla Policy Gradients and TRPO, the "batch size" is the number of trajectories, $\tau$, that we sample before we make an update, as the update is based on the expected value of a trajectory. Is this correct?



You must log in to answer this question.

Browse other questions tagged .