All Questions
Tagged with multi-task-learning deep-learning
3 questions
1
vote
1
answer
614
views
Instead of accumulating the gradient, can we accumulate loss values?
I have read and used Gradient Accumulation as a method to handle large batch size on smaller memory restrictions. It is described as following:
...
- 11
0
votes
1
answer
461
views
How should I incorporate numerical and categorical data as part of the inputs to the U-net for semantic segmentation?
I am using a U-Net to segment cancer cells in images of patients' arms. I would like to add patient data to it in order to see if it is possible to enhance the segmentation (patient data comes in the ...
- 115
7
votes
1
answer
2k
views
How to deal with losses on different scales in multi-task learning?
Say I'm training a model for multiple tasks by trying to minimize sum of losses $L_1 + L_2$ via gradient descent.
If these losses are on a different scale, the one whose range is greater will dominate ...
- 1,040