Simply yes, but it can lead to over fixing of the NN.