I am training an AlexNet neural network, with about 12000 images which 80% is for training, 10% is for validation and another 10% is for testing. I have a problem in my plots. There is a big fluctuation in epoch 47, how can I have a smooth plot? What is the problem?

enter image description here

I tried to increase my validation data because the fluctuation was for validation loss. but nothing changed. I decreased learning rate, but it stucks in a local optimum.

  • $\begingroup$ If you are using ReLu mabe multiple important ReLus are becoming dead? $\endgroup$ – DuttaA Mar 25 at 21:48
  • $\begingroup$ @DuttaA how can I solve it? $\endgroup$ – SahaTib Mar 25 at 22:04

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.