I trained a neural network on the UNSW-NB15 dataset, but, during training, I am getting spikes in the loss function. The algorithms see part of this UNSW dataset a single time. The loss function is plotted after every batch.
For other datasets, I don't experience this problem. I've tried different optimizers and loss functions, but this problem remains with this dataset.
I'm using the
fit_generator() function from Keras. Is there anyone experience this problem using Keras with this function?