Consider the following excerpt from section 5.5 Regularization (p. 13) of this chapter Logistic Regression.
There is a problem with learning weights that make the model perfectly match the training data. If a feature is perfectly predictive of the outcome because it happens to only occur in one class, it will be assigned a very high weight. The weights for features will attempt to perfectly fit details of the training set, in fact too perfectly, modeling noisy factors that just accidentally correlate with the class. This problem is called overfitting.
What are the 'noisy factors' here? Does it refer to the features that are irrelevant to the class label?
Or does it mean the noise/errors in the values taken by features that accidentally correlate with the class label?