I am reviewing my Neural Network lectures and I have a doubt: My book's (Haykin) batch PTA describes a cost function which is defined over the set of the misclassified inputs.

I have always been taught to use MSE < X as a stopping condition for the training process. Is the batch case different? Should I use as stopping condition size(misclassified) < Y (and as a consequence when the weight change is very little)?

Moreover, the book uses the same symbol for both the training set and the misclassified input set. Does this mean that my training set changes each epoch?

Than you for any answer!

  • $\begingroup$ What does "MSE < X" actually mean? I can infer that MSE is the mean-squared error and X is maybe the input, but what kind of operation is that? Less than? It is not clear what your stopping condition is. What is the name of the book? To prevent overfitting, you can often detect it by seeing an improvement in the performance (e.g. accuracy) on the training dataset, but a decrease in performance on the evaluation dataset. This is often a sign of overfitting. See: stats.stackexchange.com/q/131233/82135. $\endgroup$ – nbro Feb 6 '19 at 21:09
  • $\begingroup$ Sorry for the lack of clarity. for "MSE < X" I meant "MSE lower than a certain value X". I always been taught to use this stopping condition to prevent overfitting (as you told me) and stop the training when a certain precision on the train set (let's say 95%) is met. $\endgroup$ – Iacopo Olivo Feb 8 '19 at 0:18

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.