Let's say our task is to pick and place a block, like: https://gym.openai.com/envs/FetchPickAndPlace-v0/
Reward function 1: -1 for block not placed, 0 for block placed
Reward function 2: 0 for block not placed, +1 for block placed
I noticed training 1 is much faster than 2... I am using the HER implementation from OpenAI. Why is that?