Questions tagged [l2-regularization]

For questions related to $L_2$ regularization (aka ridge regression or weight decay), a special case of Tikhonov regularization where the Tikhonov matrix is a multiple of the identity matrix.

3 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
4
votes
0answers
45 views

When is using weight regularization bad?

Regularization of weights (e.g. L1 or L2) keeps them small and standardized, which can help reduce data overfitting. From this article, regularization sounds favorable in many cases, but is it always ...
2
votes
1answer
63 views

Does L1/L2 Regularization help reach an optimum result faster?

I understand that L1 and L2 regularization helps to prevent overfitting. My question is then, does that mean they also help a neural network learn faster as a result? The way I'm thinking is that ...
0
votes
0answers
30 views

What is the effect of too harsh regularization?

While training a CNN model, I used an l1_l2 regularization (i.e. I applied both $L_1$ and $L_2$ regularization) on the final layers. While training, I saw the ...