I have the following results I am trying to make sense of. I have attached the loss curves here for reference.
As you can see, the first issue is that the validation loss is lower than the training loss. I think this is due to using a pre-trained model with a high dropout rate (please correct me if I am wrong here).
As one can see, the
mean_aucscore is increasing consistently, and so it seems that the network is indeed learning something and the validation loss is also better behaved relatively.
The training loss is what bugs me a lot. It is not at all consistent and varies a lot. This is a naive question, but is this graph giving me any sort of information about the learning rate, etc, or am I in a situation wherein everything is incorrect essentially?
Any response would be really appreciated.