Let's say an image has 28*28 pixels, which leads to 784 input nodes, with various greyscale values, and 10 output nodes, if the in a feed-forward neural network. If an image can be classified into 1 of 10 numbers (e.g. MNIST), there are 10 output nodes.
WhenWe train (with gradient descent and back-propagation) the training data is used forFFNN with a set of known pictures of numbers, the weights and hidden layers uses forward- and backpropagation to getuntil we get the proper hidden and weight layers for the known layera good accuracy.
HoweverSuccessively, doesn'twe get a new training picture destroy, which we want to use to train the trained and balanced weights and nodes' values? BecauseFFNN even further. However, wouldn't this new training picture destroy the previously learned weights and hidden nodes, which have been calibrated to recognize the former training picturepictures?