Consider the following excerpt on overfitting from p13section 5.5 Regularization (p. 13) of this chapter LinearLogistic Regression.
There is a problem with learning weights that make the model perfectly match match the training data. If a feature is perfectly predictive of the outcome outcome because it happens to only occur in one class, it will be assigned assigned a very high weight. The weights for features will attempt to perfectly perfectly fit details of the training set, in fact too perfectly perfectly, modeling noisy factors that just accidentally correlate with the the class. This problem is called overfitting.
What are the 'noisy factors' here? Does it refersrefer to the features that are irrelevant to the class label?
Or does it mean the noise/errors in the values taken by features that accidentally correlate with the class label?