I'm training a deep learning model. After each epoch I measure the performance of the model on validation set. Here is how the performance looks like while training:
It's a binary classification task with cross entropy loss function. I use argmax at the last layer to do the prediction and measure precision and recall. Note, the number of positive and negative samples within each mini batch are almost the same (mini-batches are balanced). Any idea about possible reasons that the model is behaving like this? And how I can improve the recall as well as making it more stable like the precision?