All Questions
Tagged with multi-task-learning gradient-descent
1 question
7
votes
1
answer
2k
views
How to deal with losses on different scales in multi-task learning?
Say I'm training a model for multiple tasks by trying to minimize sum of losses $L_1 + L_2$ via gradient descent.
If these losses are on a different scale, the one whose range is greater will dominate ...
- 1,040