Skip to main content
I tried to formulate this question/post in a clearer way (including the title) and I added more relevant tags.
Source Link
nbro
  • 41.4k
  • 12
  • 114
  • 205

Let's say an image has 28*28 pixels, which leads to 784 input nodes, with various greyscale values, and 10 output nodes, if the in a feed-forward neural network. If an image can be classified into 1 of 10 numbers (e.g. MNIST), there are 10 output nodes.

WhenWe train (with gradient descent and back-propagation) the training data is used forFFNN with a set of known pictures of numbers, the weights and hidden layers uses forward- and backpropagation to getuntil we get the proper hidden and weight layers for the known layera good accuracy.

HoweverSuccessively, doesn'twe get a new training picture destroy, which we want to use to train the trained and balanced weights and nodes' values? BecauseFFNN even further. However, wouldn't this new training picture destroy the previously learned weights and hidden nodes, which have been calibrated to recognize the former training picturepictures?

Let's say an image has 28*28 pixels, which leads to 784 input nodes, with various greyscale values, and 10 output nodes, if the image can be classified into 1 of 10 numbers.

When the training data is used for a set of known pictures of numbers, the weights and hidden layers uses forward- and backpropagation to get get the proper hidden and weight layers for the known layer.

However, doesn't a new training picture destroy the trained and balanced weights and nodes' values? Because the weights and hidden nodes have been calibrated to recognize the former training picture?

Let's say an image has 28*28 pixels, which leads to 784 input nodes in a feed-forward neural network. If an image can be classified into 1 of 10 numbers (e.g. MNIST), there are 10 output nodes.

We train (with gradient descent and back-propagation) the FFNN with a set of known pictures until we get a good accuracy.

Successively, we get a new training picture, which we want to use to train the FFNN even further. However, wouldn't this new training picture destroy the previously learned weights, which have been calibrated to recognize the former training pictures?

deleted 50 characters in body; edited tags
Source Link
nbro
  • 41.4k
  • 12
  • 114
  • 205

Neural Network Could new training beginner questionpictures destroy the trained weights of the neural network?

I have a question about the training sequence regarding Neural Network recognition. Let's say an image has 28*28 pixels, which leads to 784 Input Nodesinput nodes, with various greyscale values, and 10 output nodes, if the image shows a number 0-9can be classified into 1 of 10 numbers. Then when

When the training data is used for a set of known pictures of numbers, the weights and hidden layers uses forward- and backpropagation to get get the proper hidden and weight layers for the known layer. 

However, doesn't a new training picture destroy the trained and balanced weights and nodesnodes' values? Because the weights and hidden nodes have been calibrated to recognize the former training picture? Thank you for assistance.

Kind regards David

Neural Network training beginner question

I have a question about the training sequence regarding Neural Network recognition. Let's say an image has 28*28 pixels, which leads to 784 Input Nodes with various greyscale values and 10 output nodes, if the image shows a number 0-9. Then when the training data is used for a set of known pictures of numbers, the weights and hidden layers uses forward- and backpropagation to get get the proper hidden and weight layers for the known layer. However, doesn't a new training picture destroy the trained and balanced weights and nodes values? Because the weights and hidden nodes have been calibrated to recognize the former training picture? Thank you for assistance.

Kind regards David

Could new training pictures destroy the trained weights of the neural network?

Let's say an image has 28*28 pixels, which leads to 784 input nodes, with various greyscale values, and 10 output nodes, if the image can be classified into 1 of 10 numbers.

When the training data is used for a set of known pictures of numbers, the weights and hidden layers uses forward- and backpropagation to get get the proper hidden and weight layers for the known layer. 

However, doesn't a new training picture destroy the trained and balanced weights and nodes' values? Because the weights and hidden nodes have been calibrated to recognize the former training picture?

Bumped by Community user
Bumped by Community user
Bumped by Community user
Bumped by Community user
Source Link
David
  • 41
  • 1

Neural Network training beginner question

I have a question about the training sequence regarding Neural Network recognition. Let's say an image has 28*28 pixels, which leads to 784 Input Nodes with various greyscale values and 10 output nodes, if the image shows a number 0-9. Then when the training data is used for a set of known pictures of numbers, the weights and hidden layers uses forward- and backpropagation to get get the proper hidden and weight layers for the known layer. However, doesn't a new training picture destroy the trained and balanced weights and nodes values? Because the weights and hidden nodes have been calibrated to recognize the former training picture? Thank you for assistance.

Kind regards David