1

The loss graph indicates that the model already after few epochs converged to a local minima, and the weights starts to oscillate around it. learning rate is surely responsible for it, but it's not the only culprit. Reducing learning rate with a scheduler didn't work in your case most likely cause SGD apply the same learning rate to all weights, and it seems ...


Only top voted, non community-wiki answers of a minimum length are eligible