Skip to main content
deleted 15 characters in body; edited tags
Source Link
nbro
  • 41.4k
  • 12
  • 114
  • 205

Consider the following excerpt on overfitting from p13section 5.5 Regularization (p. 13) of this chapter LinearLogistic Regression.

There is a problem with learning weights that make the model perfectly match match the training data. If a feature is perfectly predictive of the outcome outcome because it happens to only occur in one class, it will be assigned assigned a very high weight. The weights for features will attempt to perfectly perfectly fit details of the training set, in fact too perfectly perfectly, modeling noisy factors that just accidentally correlate with the the class. This problem is called overfitting.

What are the 'noisy factors' here? Does it refersrefer to the features that are irrelevant to the class label?

Or does it mean the noise/errors in the values taken by features that accidentally correlate with the class label?

Consider the following excerpt on overfitting from p13 of Linear Regression.

There is a problem with learning weights that make the model perfectly match the training data. If a feature is perfectly predictive of the outcome because it happens to only occur in one class, it will be assigned a very high weight. The weights for features will attempt to perfectly fit details of the training set, in fact too perfectly, modeling noisy factors that just accidentally correlate with the class. This problem is called overfitting.

What are the 'noisy factors' here? Does it refers to the features that are irrelevant to the class label?

Or does it mean the noise/errors in the values taken by features that accidentally correlate with the class label?

Consider the following excerpt from section 5.5 Regularization (p. 13) of this chapter Logistic Regression.

There is a problem with learning weights that make the model perfectly match the training data. If a feature is perfectly predictive of the outcome because it happens to only occur in one class, it will be assigned a very high weight. The weights for features will attempt to perfectly fit details of the training set, in fact too perfectly, modeling noisy factors that just accidentally correlate with the class. This problem is called overfitting.

What are the 'noisy factors' here? Does it refer to the features that are irrelevant to the class label?

Or does it mean the noise/errors in the values taken by features that accidentally correlate with the class label?

edited title
Link
hanugm
  • 4k
  • 3
  • 28
  • 59

What are the 'noisy factors' that leadsleading to overfitting?

Source Link
hanugm
  • 4k
  • 3
  • 28
  • 59

What are the 'noisy factors' that leads to overfitting?

Consider the following excerpt on overfitting from p13 of Linear Regression.

There is a problem with learning weights that make the model perfectly match the training data. If a feature is perfectly predictive of the outcome because it happens to only occur in one class, it will be assigned a very high weight. The weights for features will attempt to perfectly fit details of the training set, in fact too perfectly, modeling noisy factors that just accidentally correlate with the class. This problem is called overfitting.

What are the 'noisy factors' here? Does it refers to the features that are irrelevant to the class label?

Or does it mean the noise/errors in the values taken by features that accidentally correlate with the class label?