I have a CNN architecture for CIFAR-10 dataset which is as follows:
Convolutions: 64, 64, pool
Fully Connected Layers: 256, 256, 10
Batch size: 60
Optimizer: Adam(2e-4)
Loss: Categorical Cross-Entropy
When I train this model, training and testing accuracy along with loss has a very jittery behavior and does not converge properly.
Is the defined architecture correct? Should I have a max-pooling layer after every convolution layer?
plot_model(your_model_object)
? Moreover, you should provide the plots that show the behavior of the accuracy and loss. You should explain for how long you have been training. $\endgroup$ – nbro♦ Oct 31 '20 at 10:40